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Extensive experimental and numerical studies of the non-equilibrium dynamics of spin glasses 
subjected to temperature or bond perturbations have been performed to investigate chaos and 
memory effects in selected spin glass systems. Temperature shift and cycling experiments were 
performed on the strongly anisotropic Ising-like system Feo.sMuo.sTiOa and the weakly anisotropic 
Heisenberg-like system Ag(ll at% Mn) , while bond shift and cycling simulations were carried out on 
a 4 dimensional Ising Edwards- Anderson spin glass. These spin glass systems display qualitatively 
the same characteristic features and the observed memory phenomena are found to be consistent 
with predictions from the ghost domain scenario of the droplet scaling model. 
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I. INTRODUCTION 

Spin glasses (SG) have been an active field of research 
for the last three decades. Experimental and theoreti- 
cal studies have revealed an unexpected complexity to a 
deceivingly simple problem formulation^^ Many open 
questions still remain, not the least concerning the non- 
equilibrium dynamics of the spin-glass phase.^'^ Aging, ^ 
rejuvenation and memorj«2i^ are intriguing characteristics 
of the non-equilibrium dynamics in spin glasses. Sim- 
ilar features are to a certain extent found also in other 
glassy systems such as orientational glassesj^polymerSfiS 
strongly interacting nanoparticle systems colos- 
sal magnetoresistive manganitea^^, and certain ceramic 
superconductors li^ii^ 

Aging itself can be found in much simpler systems like 
standard phase separating systems. An example is a mix- 
ture of oil and vinegar used in salad dressing. By strongly 
shaking the mixture the system can be rejuvenated and 
slow growth of equilibrium domains of oil and vinegar is 
observed afterward. Then the first non-trivial question 
is what is growing in glassy systems during aging. More- 
over the aging observed in spin glasses is very unusual 
in several respects. First, the spin glass system can be 
strongly rejuvenated by an extremely weak perturbation 
such as a small change of temperature. Second, memory 
effects can be observed even after such strong rejuvena- 
tion. These two aspects are in sharp contrast to the aging 
in simpler systems. In the case of the oil -t- vinegar sys- 
tem, one has to shake the mixture strongly to rejuvenate 
it and such a strong rejuvenation will completely elimi- 
nate memories of the original mixture. 

A natural physical picture for the aging, rejuvenation 
and memory effects in spin-glasses are proposed by the 
droplet picturaiSiiLiSiiS and its recent extension — the 



ghost domain scenario i22i2ii2^ This picture includes con- 
cepts such as aging by domain growth, rejuvenation by 
chaos with temperature or bond changes and memory by 
ghost domains. 

The purpose of this study is to find out how chaos ef- 
fects are reflected on the nonequilibrium dynamics and to 
which extent they are relevant for spin glasses within the 
available time window. It has been proposed in several 
recent papers2i2ii2S42& that the memory effects observed 
in experiments can be understood without the concept 
of temperature-chaos, but simply as due to successive 
freezing of smaller and smaller length scales on cooling, 
in other words as the classical Kovacs effect^^ observed in 
many glassy systems. The experiments and simulations 
reported in this paper are inspired by and inherit pro- 
tocols, methods and ideas from Refs. 20 21- 22 28 29 30l 
Our approach allows us to distinguish between the classi- 
cal Kovacs effect and novel rejuvenation-memory effects 
due to temperature-chaos. 

This article is organized as follows: In Sec. ^ we dis- 
cuss the consequences of chaotic perturbations (temper- 
ature or bond changes) on the non-equilibrium dynam- 
ics of spin glasses based on the ghost domain scenario. 
A special emphasis is put on how spin-glasses that have 
been subjected to a strong perturbation gradually recover 
their original spin structure. A brief introduction to ex- 
periments and simulations is given in Sec. lIIII Sect ion Hvl 
is devoted to results from detailed temperature-shift ex- 
periments on the Feo.sMno.sTiOa and Ag(ll at% Mn) 
samples and bond-shift simulations on the 4 dimensional 
Edwards- Anderson (EA) spin glass. Rejuvenation effects 
after perturbations of various strengths are investigated 
in detail. Section Ivl concerns one and two-step tempera- 
ture cycling experiments on the Ag(ll at% Mn) sample 
as well as bond-cyclings on the 4 dimension EA model. 
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The interest is the recovery of memory after various per- 
turbations. In Sec. I VII results from new memory experi- 
ments on Feo.sMng.sTiOa and Ag(ll at% Mn) samples 
are reported and the influence of cooling/heating rate 
effects are discussed. 



II. THEORY 

In this section we present the theoretical basis for 
our experimental and numerical studies on the dynam- 
ics of spin-glasses and related randomly frustrated sys- 
tems subjected to perturbations such as temperature(T)- 
shifts/cyclings and bond-shifts/cyclings. 

One major basis is the prediction of strong rejuvena- 
tion due to the so-called chaos effects originally found 
within the droplet, domain- wall scaling theory due to 
Bray-Moore and Fisher-HuseiiSiiLiSiiS This theory pre- 
dicts that spin glasses are very sensitive to changes of 
their environments. Even an infinitesimal change of tem- 
perature, or equivalently an infinitesimal change of the 
bonds, will reorganize the spin configuration toward com- 
pletely different equilibrium states. The existence of the 
anticipated chaos effects in the bulk properties of certain 
glassy systems have been confirmed by some theoreti- 
cal and numerical studies e.g. on the Edwards- Anderson 
Ising spin-glass models using the Migdal-Kadanoff renor- 
malization group method^-'^ '^^-'^-^-^^ and the mean-field 
theorjiM as well as on directed polymers in random 
medial However, numerical simulations on the EA mod- 
els on "realistic" lattices, such as the 3-dimensional cu- 
bic lattice, remain inconclusive about the existence of the 
temperature-chaos effect due to the lack of computational 
power 

i?^i?7i??i??i49,4i Furthermore, the link between the 
chaos effect and the rejuvenation effect observed in exper- 
iments remains to be clarified. It has been argued that 
the chaos effect, even if it exists, may be irrelevant at 
the length scales accessible on experimental time scales 
so that the mechanism behind the rejuvenation found in 
experiments is of a different origini^*2Si2S42ii^ In order to 
shed light on these intriguing issues we study in detail 
the crossover from weakly to strongly perturbed regimes 
of the chaos effects following recent studies iSi*^2i2^ 

The other major theoretical basis is the ghost domain 
scenario fSSiS^ which suggests dynamical memory effects 
which survive under strong rejuvenation due to the chaos 
effect. This scenario explicitly takes into account the re- 
manence of a sort of symmetry breaking field or bias 
left in the spin configuration of the system by which 
"memory" is imprinted and retrieved dynamically. We 
carefully investigate the memory retrieval process, called 
healing of the original domain structure^S^ which takes a 
macroscopic time. In previous studies, the importance 
of this process has not received enough attention. A tra- 
ditional interpretation of the memory phenomena was 
based on "hierarchical phase space pictures" 44 In the 
ghost domain scenario there is no need for such built-in, 
static phase space structures. Some predictions of the 



ghost domain scenario are also markedly different from 
conventional "real space" pictures including earlier phe- 
nomenological theory such as Koper and Hilhorst's^ and 
others'=2Sii^i which do not account for the role of the re- 
manent bias. 

It should be remarked that some basic assumptions of 
the droplet picture are debated and alternative pictures 
have been proposed, which include proposals of anoma- 
lously low energy excitations with an apparent stiffness 
exponent 6 = ^SiiLi^ However, in the present paper we 
concentrate to work out detailed comparisons between 
the theoretical outcomes of the original droplet theory 
and experimental and numerical results. 

A. Edwards-Anderson model 

In this section we consider a ±J Edwards- Anderson 
Ising spin-glass model defined by the Hamiltonian, 

H = -J2JvS.S,~hJ2s^■ (1) 

(ij) i 

The Ising spin Si is put on a lattice site i (i = I, . . . , N) 
on a d-dimensional (hyper-)cubic lattice. The inter- 
actions Jij are quenched random variables drawn with 
equal probability among ± J with J > and h is an ex- 
ternal field. In the following we choose the Boltzmann's 
constant to be fee = 1 for simplicity. 

The original form of the droplet theory only concerns 
Ising spin glasses, but we assume that essentially the 
same picture also applies for vector spin glasses. Recently 
it has e.g. been found from a Migdal-Kadanoff renor- 
malization group analysis that vector spin-glasses exhibit 
qualitatively similar but quantitatively much stronger 
chaos effects than Ising spin-glasses 4^ 

B. Overlaps between equilibrium states of different 
environments 

We assume that an equilibrium spin glass state F^^'-^^ 
is represented by its typical spin configuration specified 
as ^9ea(T')(Tj-^"^-' where i = 1..N. Here T is a tempera- 
ture below the spin-glass transition temperature Tg and 
represents a given set of bonds Jij. The parameter 
qEA{T) is the Edwards- Anderson (EA) order parameter 
which is 1 as T — > and decreases by increasing T due 
to thermal fluctuations. Apart from the thermal fluctua- 
tions parametrized by qea, the typical spin configuration 
is represented by the backbone spin configuration rep- 
resented by quenched random variables {c^i"^"^^} which 
takes Ising values ±1. Furthermore, we assume that the 
only other possible equilibrium state at the same envi- 
ronment (r, J^) is f whose configuration is given by 

The scaling theorjiiSiiLiS suggests the chaos effect: 
The backbone spin configuration {cr^'^^} changes signif- 



icantly by slight changes of the environment (T, J") . Our 
interest in the present paper is to investigate how this ef- 
fect is reflected on the dynamics. Let us consider two sets 
of different environments A = {T,J) and B = {T',J') 
which are specified from the following: 

1. Temperature-change 

The temperature-change simply means T' — T + 
AT with an infinitesimal AT and J — J' . 

2. Bond-change 

The set of bonds J' is created from J by changing 
the sign of an infinitesimal fraction poi J randomly 
while T = T' . As noted in Rcf. 37 this amounts to 
a perturbation of strength A J ~ J \/p- 

The relative differences between the backbone spin 
configurations may be detected by introducing the local 
overlap 

Ot^ = at of (2) 

which takes Ising ±1 values. In Fig.Q] a schematic pic- 
ture of the configuration of the local overlap {O/^^} is 
shown. The spatial pattern of the local overlap can be 
decomposed into blocks: The value of the local overlap 
O"^^ is essentially uniform (either +1 or —1) within a 
given block while the values on different blocks are com- 
pletely uncorrelated. The correlation length of the local 
overlaps, which is the typical size of the blocks, corre- 
sponds to what is called the overlap length between Ta 
and . In the case of temperature changes the overlap 
length is given by, 

/ .(r)|AT| \-^/^ 

where Lq, T(T) and C(> 0) are the unit length scale the 
stiffness constant and the chaos exponent, respectively. 
The factor s(T) describes the temperature dependence 
of the droplet entropj*2^. For the case of bond perturba- 
tions, the overlap length associated with a bond pertur- 
bation of strength A J is expected to scale as, 

Taj - To(|AJ|/J)-i/C (4) 

with^^ |AJ| ~ Jy/p- Note that the chaos exponent ( is 
expected to be the same for both temperature and bond 
chaos. We emphasize that a strong bond-chaos effect 
induced by an infinitesimal change of the bonds is as 
non-trivial as the temperature chaos effect. It should 
be noted that such a sensitive response to a perturbation 
does not happen in non-frustrated systems such as simple 
ferromagnets. 

The above picture is the simplest one which only takes 
into account typical aspects of the chaos effect. Let us 
present an improved discussion on how the bulk of the 
equilibrium spin glass state is affected by perturbations 
on various length scales. It will lead us to find a crossover 
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FIG. 1: A schematic picture of the configuration of the local 
overlap Of^ between the equilibrium state Ta and Fb- The 
black and white represents ±1 values of the local overlap. As 
a first approximation, the configuration of the local overlap 
can be described as a collection of "blocks" of linear size of 
the overlap length Lat within which the sign of the overlap is 
biased to positive (black) or negative (white). However there 
are minorities within the blocks which have the opposite sign 
of those of the majorities. 

from a weakly perturbed regime L <^ L^t to a strongly 
perturbed regime L ^ Tat- For simplicity, let us decom- 
pose a block of size L'^j, into smaller sub-blocks of linear 
size T„ = Tat/2" with n = 1, 2, . . .. The majority of the 
sub-blocks will have a common value of the local overlap 
O"^^ (either -f 1 or —1). However, there will be minority 
sub-blocks which have the opposite sign of the overlap 
with respect to the majority. The probability Pminor that 
a sub-block belongs to such a minority group is expected 
to be a function of the scaled length y = Ln/LAT = 2~". 
In the weakly perturbed regime y <C 1 the probability 
scales asriiS^ 

(y) cx / y < 1 (5) 

Note that Pminor is simply proportional to | AT| or | A J| as 
can be seen by inserting Eq. Q or Eq. Q in Eq. jSJ. The 
presence of the minority phase is due to marginal droplets 
with vanishingly small free-energy gap which easily re- 
sponds to perturbations i^i*^2i^ For a detailed discussion 
see Refs. I21..35. Note that the probability Pminor(2/) in- 
creases with increasing length (y) and saturates to 1 as 

C. Relaxation in a fixed working environment 

Consider aging in a given working environment A — 
(TatJ^a) after a rapid temperature quench from above 
the spin glass transition temperature Tg down to a work- 
ing temperature Ta below Tg. We suppose that aging can 
be understood in terms of domain growth. Let us start by 
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giving a general definition of a domain. First, we average 
out short time thermal fluctuations on the temporal spin 
configuration Si{t). Then the spin configuration at time 
t may be represented by y^qEA{TA)si{t). Here Si{t) is 
an Ising variable which represents a coarse-grained tem- 
poral spin configuration. Second, we project this spatio- 
temporal spin configuration onto any desired reference 
equilibrium state Fr at an environment R = (T^j, JTr), 



(6) 



Now we define a domain with respect to the general ref- 
erence state Fr. It has the following two essential prop- 
erties: 

• A domain belonging to Fr, (or Tr) is a local region 
in the space within which the sign of the projection 
sf is biased to either positive or negative. The 
spatial variation of the sign of the bias defines the 
geometrical organization of domains, i.e. domain 
wall configuration. 

• The amplitude of the bias in the interior of a domain 
is the order parameter defined as 



1 



E 

ie a domain of Fr 



it) 



(7) 



where Mr is the number of spins belonging to the 
domain. The amplitude of the bias can be smaller 
than 1 indicating that the interior of the domain is 
"ghostlike" (see Fig. 

To avoid confusion, let us note that the order parameter 
defined above is different from the EA order parameter 
qea which parametrizes the thermal fluctuations on top 
of the backbone spin configuration. 

The natural choice for the reference equilibrium state 
is R = A, i.e. the equilibrium state Fa, of the work- 
ing environment A = {Ta,J^a) itself. After time t from 
the temperature quench, domains belonging to F^i and 
Ta will have a certain typical size (t) . The domain 
size Lxjiit) will grow very slowly by activated dynamics. 
Here the subscript Ta is used to emphasize the tempera- 
ture dependence of the growth law [see Eq. (|A2p ]. (The 
growth law is discussed in detail in appendix IXI) Note in 
this context that the order parameter pA [Eq. Q] within 
the domains belonging to Fa and Ta takes the maximum 
value 1 constantly during isothermal aging. 

Let us now consider more generally what is happen- 
ing on the reference states associated with different en- 
vironments during isothermal aging, i.e. R ^ A . As 
illustrated schematically in Fig. |21 the domains of the 
reference states at different environments R ^ A will 
grow with time up to the overlap length between F"^ and 
F^. Concerning this point it is useful to note the relation 
between the projections sf (t) and sf-{t) given by. 




FIG. 2: (Color online) A schematic illustration of the temper- 
ature profiles of the effective domain size around the working 
temperatures Ta and Tb ■ The solid and dotted lines represent 
the effective domain size Lcff(i) at logarithmically separated 
times t during isothermal aging at Ta and Tb respectively. 



which immediately follows from Eq. ©. Here Of'^ is 
the overlap between the equilibrium state F^^ and T r 
defined in Eq. The spatial pattern of overlap Of^ 
is roughly uniform over the length scale of the overlap 
length Lat between T a and Tr. Beyond I/at, however, 
the configuration of the overlap Of^ is random. Then it 
follows that the growth of domains belonging to Ta ( and 
F^) only contributes to the growth of domains belonging 
to Tr (and T r) up to the overlap length. Thus we expect 
that at environment R the typical domain size, which 
we denote as effective domain size Lcs{t), should scale 
asM 



icff (t) = ^atF 



Lat 



(9) 



The scaling function F{x) reflects the following three 
regimes as the age of the system, t^r, increases: 

1. Accumulative regime 

At length scales much shorter than the overlap 
length Lat, the growth of the domains belonging 
to F^ leads to the growth of the domains belonging 
to Tr such that Lcff(iw) — Lta(*w)- This yields 



lim F(x) — X. 



(10) 



(t) = O 



AR~A 



(8) 



2. Weakly perturbed regime 

As we discussed in the previous subsection, the 
chaos effect emerges gradually at length scales 
shorter than the overlap length. We now want to 
determine the first correction term to Eq. H1U|) due 
to defects at the scale of Lta(0- Intuitively we as- 
sume that Lcff is analytic and an even function of 
AT (and AJ). We also expect that the correction 
term is an analytic function of Pminor [See Eq. ||SJ)] 
which is proportional to |AT| (and |AJ|). Com- 
bining these we find that the fist correction term 
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should be O(Pniinor) leading to^ 

F{x) =^ x{l- cx^'^) x<l. (11) 

We note that because of defects at length scales 
L <^ LT^{t) the order parameter [Eq. ((T))] is 
smaller than pA — ^■ 

3. Strongly perturbed regime 

The domains belonging to Tr can by aging at A 
only grow to the size of the upper bound Lat, 
yielding Lcff(iw) = -^at- This requires 

F{x) = l x>l. (12) 

D. Relaxation after shift of working environments 

Let us now consider a shift of working environment 
A ^ B, after aging the system in the environment A 
for a time t^. is the reference state since the work- 
ing environment is now B. Just after the T-shift, the 
sizes of the domains F b associated with the environment 
B (at temperature Tb) is given by the effective domain 
size Leff(iw) in Eq. © (see Fig. |2J). Thus the spin con- 
figuration just after the temperature shift Ta — > Tb is 
equivalent to that after usual isothermal aging done at 
B for a certain waiting time tgg (after direct temperature 
quench from above Tg down to Tb). The effective time, 
teB, is defined through 

Ttb (^cff) = Tcff(iw)- (13) 

Since Toff (^w) is limited by the overlap length Tat reju- 
venation occurs after the temperature (or bond)- shifts: 
the system looks younger [i.e. iTis (icff) < LT^itw)] than 
it would have been if the aging was fully accumulative 

[i.e. Lxsites) = iTA(*w)]- 

The effective time tes can be determined experimen- 
tally by measuring the ZFC relaxation after tempera- 
ture and bond shifts (see Sec. llVjl . As in the isother- 
mal casCf^ a crossover occurs between quasi-equilibrium 
and out-of-equilibrium dynamics at Lxsit) ~ ^^^(icff), 
where Ltb {t) is the length scale on which the system is 
observed at time t after the temperature (or bond) shift. 

Now let us turn our attention to what happens to the 
amplitude of order parameters within the domains after 
T-shifts, 

• The order parameter ps within domains belonging 
to Fs evolves as follows. Although the system is 
essentially equilibrated with respect to B up to the 
effective domain size Loff(^w)j it contains some de- 
fects which cause a certain reduction of the order 
parameter. These defects are progressively elimi- 
nated after the T-shift and pB approaches the full 
amplitude 1. At time t after the shift of environ- 
ment, such defects smaller than {t) are elimi- 
nated, but the larger ones still remain. Thus, this 



process finishes once defects as large as the domain 
size Leff are removed. The time scale needed to 
finish this transient process is given by 

TTb (^trans) — Toff (14) 

thus ttrans ^ ^off bccausc of Eq. ifT^ . 

• The order parameter within domains belonging to 
equilibrium states at other temperatures T 7^ Tb 
evolves as follows. At length scales greater than 
Lat=(t-Tb)/t (see Fig. |3) the domains grown be- 
fore the T-shift suffer a progressive reduction of the 
order parameter. However, the spatial pattern of 
the sign of the bias remains the same as before the 
T-shift (see Fig.Ej). This is a very important point 
that we discuss in detail in sec. Ill El 

Let us also remark that the population of thermally 
active droplets at a certain scale L, which is proportional 
to^ {kuT / J){L / Lf))^^ , cannot follow sudden changes of 
the working temperatures, but needs a certain time to be 
switched off (or switched on). Progressive adjustments of 
the population of thermally active droplets take place on 
the time scale ttrans defined in Eq. IT4l 

In experiments, the progressive elimination of the re- 
manent defects on domains belonging to F^ after the 
shifts should give rise to certain excessive contributions 
to the relaxation of the magnetic susceptibility with the 
duration time itrans given above. The amplitude of the 
excessive response is expected to be proportional to AT 
or A J. This is because both the population of the iso- 
lated defects due to the chaos effect in the weakly per- 
turbed regime (see Eq. (0)) and the excessive thermal 
droplets are proportional to AT or A J. 

E. Relaxation under cyclings of working 
environments 

We are now in position to discuss dynamics under cy- 
cling of working environments such as temperature cy- 
cling. Here we consider the simplest protocol. 1) Initial 
aging stage - after a temperature quench from above Tg, 
the system is aged for a time iwi within environment A 
- {Ta,Ja)- 2) Perturbation stage - Then a "perturba- 
tion" is applied and the system is aged a time ^-f the 
new environment B - {Tb, Jb)- 3) Healing stage - finally 
the working environment is brought back to A where the 
spin structure obtained in the initial aging stage slowly 
"heals" from the effects of the perturbation. 

1. Weakly perturbed regime 

Let US focus on what is happening on length scales 
shorter than the overlap length Tat during the one-step 
cycling introduced above. This will be relevant for ob- 
servations at correspondingly short time scales in experi- 
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FIG. 3: (Color online) An illustration of the evolution of ghost domains in a "perturbation-healing" protocol at large length 
scales. The above pictures are generated by an artificial simulation: Monte Carlo simulation is performed on a set of Ising spins 
on a square lattice by cycling the working Hamiltonian given by Mattis models whose ground states are exactly given by a'* 
and (see the note— for the details). The different colors represent the sign + and — of the projections sf{t) (top figures) 
and sf (t) (bottom figures) at the end of initial aging state of duration iw , at the end of the perturbation stage of duration Tp 
and after time in the healing stage. Here the backbone spin configuration of the target equilibrium states and are 
completely unrelated random configurations so that the local overlap = s^(t)sf (t) — a^a^ (see Eq. Q) is a completely 
random configuration: the overlap length is just 1 in the unit lattice. The remanent bias at the end of the perturbation stage 
is found as (left) prom ~ 0.15 and (right) prcm ~ 0.04. In the former the human eyes just barely distinguish the ghost domains, 
whereas in the latter the domains have become indistinguishable. In both cases, the strength of the bias increases up to 0(1) 
in the healing stage: (left) pi^c ~ 0.59 and (right) prcc ~ 0.58. 



ments and simulations. The effect of the change of work- 
ing environments should be perturbative in the weakly 
perturbed regime L < L^t as we discuss below. 

During the perturbation stage, the growth of domains 
belonging to Tb introduces rare defects of size L on top 
of the domains belonging to Ta with a probability pro- 
portional to (L/Lat)'' ^ 1 (see Eq. ©). Since the prob- 
ability is low, these defects are isolated from each other. 
During the healing stage, these island like objects are 
progressively removed one by one from the small ones up 
to larger ones. Since the maximum size of such a defect 
is LB{tvi^), we find that the removal of the defects will 
be completed in a time scale t^gc^ given by 



(15) 



Here the super-script "weak" indicates that the formula 
is valid only in the weakly perturbed regime. After this 
recovery time the original state of interior of the domains 
belonging to Tb is restored. Finally let us also note that 
domain size at A continues to grow during the aging at 
B and vice-versa within the weakly perturbed regime. 



Lat should come into play. Figure |31 gives an illustra- 
tion of how projections sf{t) and sf{t) evolves at length 
scales greater than the overlap length. The unit of length 
scale is chosen to be the overlap length Lat- Thus the 
pattern of the local overlaps Of^ is completely random 
beyond the unit length scale. 

In the initial aging stage, the domains belonging to F"^ 
grow up to the size Lt^ {twi ) ■ The amplitude of the order 
parameter within the domains has the full amplitude (1) 
everywhere. 

In the perturbation stage, the system is relaxing in the 
environment B. Since the spin configuration before the 
perturbation stage is completely random with respect to 
B beyond the overlap length Lat, the domains belonging 
to F-^ grow independently of the previous aging. In the 
meantime, the domains belonging to F'^ become "ghost" 
like, i.e. they keep their overall "shape" while their inte- 
rior becomes noisy due to the growth of domains belong- 
ing to the reference state B. The remanent strength of 
the order parameter of A defined in Eq. |7J| 



2. Strongly perturbed regime 



Suppose that the length scales explored during the 
three stages LxAitwi), LTBiivi^) and LTji{t) are all 
greater than the overlap lengths Lat- Then, the strongly 
perturbed regime of the chaos effect (see Sec. lIIB|l which 
appears at length scales greater than the overlap length 
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E 

ie a domain of 



(16) 



slowly decays with time t. Here ^ (Lta (*w)/io)'' is 
the number of spins belonging to a domain of F^ . After 
time t from the beginning of the perturbation stage it 
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becomespSiSS 



Lat 



(17) 



where A is a dynamical exponent. The crucially impor- 
tant point is that the spatial pattern of the sign of the 
local bias (order parameter) - with decreasing amplitude 
of strength /9rcm(i) - is preserved during the perturbation 
stages. We call this spatial structure a ghost domain. 
Such ghost domains are responsible for the memory ef- 
fect allowed after full rejuvenation induced by the chaos 
effect. 

In the healing stage, the domains belonging to Ta start 
to grow from the unit length scale Lat all over again. 
However, the initial condition for this healing stage is 
not completely random, since ghost domains with bias 
Prcm{tw2) exist. We thus need to consider domain growth 
with slightly biased initial condition^ The bias now in- 
creases with time asi^S 



Prcm (^W2 ) 



Lat 



(18) 



Since the size of the ghost domain itself is finite, it also 
continues to grow during the healing stage. Following 
Ref. |23 we call the growth of the bias inside a ghost do- 
main during the healing stage inner- coarsening and the 
further growth of the size of the ghost domain itself outer- 
coarsening. 

The growth of the bias stops when the bias (order pa- 
rameter) saturates to the full amplitude. This defines the 
recovery time i^J;™"^, 

p,ec(Cc™^; Prcm) ^ 1 L{tf^r^)/LAT ^ P^Ai^ ■ (19) 

Combining this with Eq. (|17|l the relation^^ 



Lat 



f LTb (^W2 ) 

V Lat 



A/A 



(20) 



is obtained. Here, the super-script "strong" indicates 
that the formula is valid only in the strongly perturbed 
regime. 

An important remark is that the two exponents A and 
A are in general different. In Ref. Is^ a scaling relation 
A + A = d was found. Only in the special case A = A, 
which happens e.g. in the spherical model considered in 
Ref. 2fl, the relation Eq. (|20|l is accidentally simplified 
to iT^(T^*™"s) = Ltb{tp). Concerning the exponent A 
the inequaHty is proposed as,^^ d/2 < X < d. Combining 
that with A -I- A = d, a useful inequality is obtained, 



A/A > 1. 



(21) 



In Ref. I23, the 4d Ising E A model was studied and it was 
found that A ^ 3.2 and A ~ 0.8. In this case and also 
in general for 3d systems the recovery time is very large 

^strong fweak 
''roc ^ ''roc ■ 



The above results are markedly different from what one 
would expect from conventional "real space" or "phase 
space" arguments which neglect the role of bias. If such 
a mechanism causing a symmetry breaking is absent, 
the "new domains" grown during the healing could often 
have the wrong sign of bias with respect to the original 
one leading to total erasure of memory. In contrast to 
the hierarchical phase space models;^ the ghost domain 
scenario predicts memory also in the positive T-cycling 
{Ta < Tb) case. Indeed such examples are alr eady re- 
ported (see Fig 6. in Ref. and Fig. 3 in Ref. 



3. Multiplicative rejuvenation effect 



;aQy 

Ml 



The above considerations for the one step cycling 
can be extended to multi-step cycling cases. At large 
length/time scales beyond the overlap length, some quite 
counter-intuitive predictions follow due to the multiplica- 
tive nature of the noise effecti^ For example, in a T- 
cycling TA(twi) ^ Tsit^^) ^ Tcit^^) Ta, the 
amplitude of the order parameter of A is reduced to 
Prom ^ Pb X PC in the end of the 2nd perturbation. Here 
Pb and pc represent reductions due to domain growth 
at B and C. Thus, the recovery time irec°"^ the order 
parameter of A becomes, 



^T.(ec°"") 

Lat 



Ltb (^w2 ) (tw3 )\'^^^ 



Lai 



Lai 



(22) 



This tells that sequential short time perturbations can 
cause huge recovery times. Let us note that this mul- 
tiplicative rejuvenation effect is absent at length/time 
scales smaller than the overlap length Lat- At such 
short length scales, changes of temperature (or bonds) 
only amount to put isolated island like defects on the do- 
mains which rarely overlap with each other. The multi- 
plicative effect discussed above is hardly expected within 
conventional pictures which do not contain the time evo- 
lution of the bias (order parameter). 



F. Freezing of aging by slow changes of working 
environments - heating/cooling rate effects 

The effect of finite heating/cooling rate is a very im- 
portant problem from an experimental point of view. 
Even the fastest cooling/heating rates such as those 
used in "temperature quench" experiments are always 
extremely slow compared to the atomic spin flip time 
Tm ^ fi/J ^ 10^^'^ s. Typically the maximum exper- 
imental heating/cooling rate is vt ^ 0(10^^) K/s and 
Tg ~ 0(10) K (see Appendix 0, which in simulations 
would be equivalent to an extremely slow heating/cooling 
rate of vt ~ 10~^^Tg/MCS. Thus, the instantaneous 
changes of the working environments assumed in the pre- 
vious sections are very unrealistic, at least experimen- 
tally. 
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Nonetheless, we expect that the effect of a finite heat- 
ing/cooling rate can be taken into account by introducing 
a characteristic length scale imin(wT, T). As discussed in 
Ref. 122, it is natural to expect that the competition be- 
tween accumulative and chaotic (rejuvenation) processes 
during a slow change of working environments, either 
temperature or bond changes, results in a sort of freez- 
ing of aging, such that the effective domain size with 
respect to the temporal working environment becomes 
a constant in time Lmin(wT,T')- This domain size is ex- 
pected to decrease when the rate of the changes increases, 
e.g. the heating or cooling rate vt- The characteristic 
length Lmin('^T, T) can be seen as a renormalized overlap 
length in the following senses: 

• The frozen age ^min given by LT(imin) = 
LminivTyT) scts the minimum time scale for the 
start of the domain growth when the target tem- 
perature T is just reached after continuous tem- 
perature changes. This effect can be readily seen 
experimentally as we discuss in Secs. lIVXI and lB^ 

• The overlap length Lat appearing in equations 
Eq. and Eq. should be replaced by 
Lniin{vT,T). The latter should be greater than 
the overlap length Lat between the equilibrium 
states at two temperatures connected by a continu- 
ous temperature change. Thus, the finiteness of the 
heating/cooling rate can significantly reduce the re- 
covery times for the memories. 

Indeed, it is known from previous experimental stud- 
ies that cooling/heating rate effects are non-accumulative 
and that it is only the rate very close to the target 
temperature that affects the observed isothermal aging 
behavior However, within this narrow temperature re- 
gion around the target temperature, heating/cooling rate 
effects were found to be relevant, but as long as the em- 
ployed observation time is made long even a cooling with 
VT ~ O(10~^) K/s can be regarded as a "quench" that 
allows experimental observations of non-equilibrium dy- 
namical scaling properties of isothermal aging starting 
from a random spin configuration^2ii4 An interpretation 
of this feature would be that the observation times used 
in the experiments are actually larger than the effective 
age iinin related to the renormalized overlap length. This 
remarkable feature is quite different from that of other 
glassy systems governed by simple thermal slowing down, 
such as super-cooled liquidsf^ in which the effect of ag- 
ing at different temperatures during the heating/cooling 
only add up accumulatively. It may be argued that the 
unusual cooling rate independence of the dynamics in 
spin glasses already in itself supports the relevance of 
the temperature-chaos concept. 

G. Comparisons to the classical Kovacs effect 

The mechanisms and nature of the memory effects in- 
volving length scales shorter and longer than the over- 



lap length are markedly different within the ghost do- 
main scenario. After a change of working environments 
involving only short length scales the chaos effect is 
weak (pcrturbative) and the system is not rejuvenated. 
Such non-chaotic perturbative effects yield, as discussed 
in Sec. lIIETl the trivial recovery time given by Eq. H15|l . 
This recovery time fits well with conventional intuition 
based on "length scales" or "phase space". Such ef- 
fects may be understood as classical memory effects in 
a fixed energy landscape known as Kovacs effects in poly- 
mer glasses, ?7 which do not accompany a real rejuvena- 
tion. It is reasonable to expect that Kovacs effects exist 
in a broad class of systems^iSSiSiS as far as the chaos 
effects are absent or irrelevant. The fixed energy land- 
scape picture is valid only at length scales shorter than 
the overlap length where defects are approximately inde- 
pendent of each other. For perturbations involving length 
scales greater than Xat this picture becomes totally in- 
valid and the scenario outlined above for the strongly 
perturbed regime is required. 



III. INTRODUCTION TO EXPERIMENTS AND 
SIMULATIONS 

Experiments. — The non-equilibrium dynamics of 
two canonical spin glasses was investigated using su- 
perconducting quantum interference device (SQUID) 
magnetometry. The samples are a single crystal of 
Feo.sMno.sTiOs (Tg « 21.3 K), the standard Ising spin- 
glasS j^Tii?? and a polycrystalline sample of the Heisen- 
berg Ag(ll at% Mn) spin-glass (Tg « 32.8 K). The 
experiments were performed in non-commercial SQUID 
magnetometers designed for low- field measurements 
and optimum temperature control (see Appendix for 
details). 

Experimental results for the two samples will be pre- 
sented using the following thermal procedures: 

(i) In an isothermal aging experiment the sample is 
quenched (cooled as rapidly as possible) from a 
temperature above the transition temperature to 
the measurement temperature in the spin glass 
phase. In dc measurements, the relaxation of the 
ZFC magnetization is recorded in a small probing 
field after aging the sample in zero field for a time 
iw at the measurement temperature. 

(ii) In a T-shift experiment (Sec. IIV A|l the sample is, 
after a quench, first aged at Tj before measuring 
the relaxation at T^^Ti + AT. 

(iii) In a T-cycling experiment fSec. lV the sample is 
first aged at Tm, then at T^ + AT and subsequently 
the relaxation is recorded at T^. 

(iv) In a temperature memory experimentf*Si (Sec. IVI|I 
the system is cooled from a temperature above the 
transition temperature to the lowest temperature. 
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The cooling is interrupted at one or several temper- 
atures in the spin glass phase. The magnetization 
is subsequently recorded on re-heating. 

In experiments (i)~(iii) all temperature changes are 
made with the maximum cooling rate (fcooi ~ 0.05 K/s) 
or maximum heating rate (uhcat ~ 0.5 K/s). A tem- 
perature quench therefore refers to a cooling with the 
maximum cooling rate. The magnetic fields employed in 
the experiments are small enough (/i « 0.1 — 1 Oe) to 
ensure a linear response^*^ of the system. 



bond change J a Jb instead of a temperature change. 
The initial conditions are random spin configurations to 
mimic a direct temperature quench (with = oo) to 
T < Tg. Detailed comparisons of the effects of bond per- 
turbations and temperature changes allows us to clarify 
the common mechanism of rejuvenation and memory ef- 
fects. An important advantage of the numerical approach 
is that the dynamical length scale Lrit) can be obtained 
directly in the simulationsiS2iS Details of the model and 
the simulation methods are given in Appendix O 
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IV. REJUVENATION EFFECTS AFTER 
TEMPERATURE AND BOND SHIFTS 

In this section, we present a quantitative study of the 
rejuvenation effect using T-shift experiments and bond- 
shift simulations. 



A. Temperature-shift experiments 



5000 10000 15000 

t(s) 

FIG. 4: (Color online) Ac susceptibility vs time after a tem- 
perature quench. A temperature cycling from 30 K to 28 K 
and back to 30 K is shown as pluses. The solid lines are the 
isothermal aging at 28 K and 30 K. After the negative T-shift 
from 30 K to 28 K the system is completely rejuvenated. Still, 
after the T-cycling it keeps a memory of the first aging at 
30 K. / = 510 mHz. 

To shortly illustrate the rejuvenation and memory phe- 
nomena, that are examined in detail in this article, we 
show in Fig. 0] a negative T-cycling experiment on the 
Ag(ll at% Mn) sample. The ac-susceptibility is mea- 
sured as function of time after a temperature quench. 
The system is aged at 30 K for 3000 s, afterward the 
temperature is changed to 28 K for 3000 s, and finally it 
is changed back to 30 K. The isothermal aging at 30 K 
and 28 K are shown as references. We first notice that 
the aging at 28 K is the same in the cycling experiment 
as after a direct quench. Hence, at 28 K, the system ap- 
pears unaffected by the previous aging at 30 K — the sys- 
tem is completely rejuvenated at the lower temperature. 
However, some time (tree) after changing the temperature 
back to 30 K the ac signal is the same as if the aging at 
28 K had not taken place; despite the rejuvenation at 
28 K the system keeps a memory of the aging at 30 K. 
One of our major interests is to clarify if the memory 
recovery process with duration tree can be understood in 
terms of the ghost domain picture (Sec.|nJ. 

Simulations. - Standard heat-bath Monte Carlo sim- 
ulations of the EA Ising model (introduced in Sec. Ill A|) 
on the 4 dimensional hyper cubic lattice (Tg = 2.0J)^^ 
were performed following protocols (i)-(iii), but using a 



temperature 




log(time) 

FIG. 5: (Color online) Schematic representation of a twin T- 
shift experiment. In the experiment represented using the 
thick line, (ri,rn,) = (ri,T2), while {Ti,Tn,) = (r2,ri) in the 
experiment represented by the thin line. In ac experiments, 
x{t) is also monitored during the halt at Ti. In order to ensure 
thermal stability at Tm, a short waiting time fws = 3 s is 
needed before applying the magnetic field and recording the 
ZFC relaxationi^ 

In a T-shift experiment, the system is quenched to the 
initial temperature T'i(< Tg), where it is aged a certain 
time t^; the temperature is changed to the measurement 
temperature = Ti + AT, and ZFC-relaxation M(t) 
(or ac susceptibility relaxation) is recorded. Conjugate 
experiments with Tj and Tm being interchanged are called 
twin T-shift experiments (see Fig.|Sll. 

The effective age (icff) of the SG system at Ti„, 
due to the previous aging at Ti, can be deter- 
mined either from the maximum in the relaxation 
rate S{t) = h''^ dM{t)/d log t of ZFC relaxation 
measurementsj22iSSiS& or by the amount of time that an ac 
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susceptibility relaxation curve measured after a T-shift, 
needs to be shifted to merge with the reference relax- 
ation curve measured without a T-shift pii*2iiii We will 
here show that both ways to derive tcs are consistent, 
discuss the experimental limitations that determine the 
accuracy of the estimations and indicate in which time 
window the derived effective age gives non-trivial infor- 
mation. Finally, we will use the extracted toff data to 
quantitatively analyze the emergence of the chaos effect. 



1. ZFC relaxation after T-shifts 

The relaxation rate after twin T-shift experiments are 
shown in Fig. El for the two samples. The effective age 
(tcff) of the system after a T-shift is determined from 
the time tpoak corresponding to the maximum in S{t) 
(see Appendix IB 21 for details). The shape of the S{t) 
curves changes after both negative and positive T-shifts; 
the maximum in S{t) becomes broader with increasing 
I AT I (and for a certain |AT| also with increasing tw)- 
Due to this broadening tpcak becomes less well-defined 
and thus teS less accurate. A broadening of S{t) with in- 
creasing |AT| is observed for both samples, but it should 
be noted that the temperature shifts employed for the 
Feo.sMuo.sTiOs sample are much larger than those for 
the Ag(ll at% Mn) sample. That the data in Fig. 
shows an increase of tpcak with indicates that the 
AT's are small enough to belong to the weakly perturbed 
regime, i.e. Lxiitv,) ^ ^at- The broadening of the re- 
laxation rate can hence be explained by the weak chaos 
effect (see Sec. Ill C|l : during the aging at Ti ghost do- 
mains grow at nearby temperatures up to the overlap 
length. The interior of these ghost domains contain de- 
fects or noise and do therefore not have full amplitude 
of the order parameter [Eq. [7] . These defects are pro- 
gressively eliminated after the T-shift giving rise to ex- 
tra responses (see Sec. IIID|I . Such extra responses are 
reflected in the ZFC magnetization measurements as a 
broadening of S{t). 

For the Ag(ll at% Mn) sample, if |AT| is increased 
even further the maximum in S(t) again becomes nar- 
rower, as can be seen in Fig. [3 where positive and neg- 
ative T-shift with T^ = 30 K and U = 1000 s are 
shown for various values of Tj. For larger enough |AT| 
the peak position tpoak piles up around tmin- This <min 
(imin — LT{tmin)) is the shortest effective age (domain 
size) in the system after a T-change and it depends on 
the cooling/heating rate as discussed in Sec. Ill Fl and Ap- 
pendix IB 21 A similar behavior has been observed in a 
Cu(Mn) spin glass, as shown in Fig. 3 of Ref. |H3 That 
indicates that Tat < imin; the ex- 
perimentally accessible times [or lengths Tt^ (^w)] lie in 
the strongly perturbed regime. However since the over- 
lap length is "hidden" behind the domains grown during 
the T-change, these measurements do not give any direct 
information about the overlap length. 

For the Feo.sMnp.sTiOa sample the strongly chaotic 



regime could not be observed within the temperature 
range used in the experiments reported in the present 
section. However, we expect to see a narrowing of S(t) 
also for the Fco.sMno.sTiOa sample if |AT| is made large 
enough. 



2. ac susceptibility relaxation after T-shifts 

In an isothermal aging experiment x"{t) is recorded vs. 
time immediately after the quench (only allowing some 
time for thermal stabilization and stabilization of the ac 
signal). In a T-shift experiment, x"(t) is continuously 
measured after the initial temperature quench to Tj. In 
the following we choose t = immediately after the T- 
shift to Tm. 

T-shift ac relaxation measurements with Ti < (pos- 
itive T-shift) are shown in Fig. |SIa,c). For large enough 
AT the relaxation curves after the T-shifts become iden- 
tical to the reference isothermal aging curve. The AT/Tg 
needed to make the aging at the lower temperature negli- 
gible is however much larger for the Feo.sMng.sTiOa sam- 
ple than for the Ag(ll at% Mn) sample. If the time scale 
of these x"{t) curves are shifted by the effective time de- 
termined from the corresponding ZFC relaxation exper- 
iments reported before, they merge with the reference 
isothermal x"(0 curve. This is true for both samples 
[see the insets of Fig.|Hra,c)], however a transient part of 
the curves at short times lies below the isothermal aging 
curve. 

T-shift ac susceptibility relaxation measurements with 
Ti > T„i (negative T-shift) are shown in Fig. |HIb,d). 
For the Ag(ll at% Mn) sample, the T-shift relaxation 
curves lie below the reference isothermal aging curve for 
small |AT|. However for larger |AT| the T-shifted relax- 
ation curves lie above the reference curve and for large 
enough |AT| the relaxation curves are identical to the 
isothermal aging curve (complete rejuvenation). For the 
Feo.sMuo.sTiOa sample, no complete rejuvenation can 
be observed even for AT = -3 K (AT/Tg = -0.14), 
whereas for the Ag(ll at% Mn) sample complete reju- 
venation is already observed for |AT|/Tg > 0.03 on the 
examined time scales. Shifting the time scale by teff, 
determined from ZFC relaxation experiments, makes the 
T-shift curve merge with the reference curve at long time 
scales as shown in the insets of the figures. At short time 
scales, a long transient relaxation exists during which 
x"{t) lies above the reference curve. 

The transient part of the susceptibility Ax" shows 
nonmonotonic behavior with increasing AT in the case 
of negative T-shifts; Ax" initially becomes larger but it 
eventually disappears for large AT's as tcs 0. These 
two features can be observed for the Ag(ll at% Mn) sam- 
ple in Fig. IHIb) and complete rejuvenation (teff = and 
Ax" — 0) is shown in Fig. 2| However, only the initial 
increase of Ax" can be observed for the Feo.sMnp.sTiOa 
sample in Fig. ^d) . The nonmonotonic behavior of Ax" 
is consistent with the picture presented in Sec. Ill Dl in the 
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FIG. 6: (Color online) Relaxation rate vs time after positive and negative twin T-shift measurements. Pluses are positive 
T-shifts {Ti,T2), while squares are negative T-shifts {T2,Ti). (a) Ag(ll at% Mn) : Ti = 30 - jAT] K and T2 = 30 K. (b) 
Feo.sMno.sTiOs : Ti = 19 — |Ar| K and T2 = 19 K. Note that for each At the peak position tmax increases with and the 
maximum in S{t) broadens, which suggests that these data reflect the weakly perturbed regime of the temperature-chaos effect. 
(See later Fig. Illl for the corresponding data of bond-shifts in the 4d EA model.) 



weakly perturbed regime, the excess transient responses 
should be proportional to AT and the duration of the 
transient response ttrans is roughly the same as the ef- 
fective time toff, while in the strongly perturbed regime 
Ax" — *■ as toff ^ 0, which is the limit of complete 
rejuvenation. 



3. Non-accumulative aging 

The previous sections described how to determine the 
effective age (icff) of the SG systems after a T-shift. The 
extracted effective age can now be used to examine if the 
aging is fully accumulative or not. The advantage of the 
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t(s) 

FIG. 7: (Color online) Relaxation rate vs time after aging 
the Ag(ll at% Mn) sample at (a) Ti = 29.95, 29.9, 29.8, 29.7, 
29.6, 29.5, 29.4 K (b) T; = 30.1, 30.2, 30.3, 30.4, 30.5, 30.6, 
30.7 K using t„ = 1000 s and Tm = 30 K. Dotted lines are 
ordinary isothermal aging curves with iw = 3 and 1000 s. (See 
Fig. 3 in Ref. l6^ for the case of a Cu(Mn) spin glass.) 



twin T-shift method'^^ is that it allows one to distinguish 
between the two cases although the growth law Lxit) 
is unknown. By plotting t2 (tw or tcs at T2) vs ti (iw 
or teS at Ti), the sets of data from the positive T-shifts 
and the corresponding negative T-shifts should fall on 
the same line corresponding to ^2 = L^^^LTiiti)] if the 
aging is fully accumulative, while any deviation suggests 
emergence of rejuvenation (non-accumulative aging). 

Plots of ti vs t2 are shown in Fig.^ t^s is determined 
from the twin T-shift ZFC relaxation experiments shown 
in Fig. For the Ag(ll at% Mn) sample, the line of 
accumulative aging is shown in addition; a logarithmic 
domain growth law [Eq. ljA2p ] has been used with pa- 
rameters taken from previous studiesiSSiSS It can be seen 
for both samples that the aging is accumulative for small 
values of |AT| while for larger |AT| non-accumulative 
aging is observed (the data for positive and negative T- 
shifts do not any longer fall on the same line). There 
is however a large difference between the two samples as 
to how large values of |AT|/Tg are required to introduce 
non-accumulative aging. A similar analysis of t^s after 
twin T-shift experiments was recently performed on the 
3d EA Ising model.'^i Only very weak rejuvenation effects 
could be observed for the Ising model on the time/length 
scales accessible by the numerical simulations even for 
such large AT/Tg as 0.3. 



4- Evidence for temperature- chaos 

Is the non-accumulative aging consistent with temper- 
ature chaos as predicted by the droplet model? In order 
to answer that question we need to transform timescales 
into length scales. In other words we need to know the 
functional form of the domain growth law. In Ref. 
was shown that the ac relaxation data measured at dif- 
ferent frequencies and temperatures are consistent with a 
logarithmic domain growth law [Eq. HA2|) ]. The temper- 
atures used in that study include those in Fig. for the 
Ag(ll at% Mn) sample, but not for the Feo.sMno.sTiOa 
sample. We therefore restrict the search of temperature- 
chaos to the Ag(ll at% Mn) sample. 

For the Ag(ll at% Mn) sample, we showed in Ref.l28l 
that positive and negative twin T-shifts can be made 
equivalent by plotting TT,„(icff) vs LT^itvi)- This sup- 
ports the expectation of the droplet theorjiiSiii that there 
is a unique overlap length between a given pair of temper- 
atures. By scaling Lr^(teff) and LT^{t^) with the overlap 
length Tat = -^o(a|AT|/Tg)~^/'', all data corresponding 
to different Tj, T^, and merge on a master curve if 
1/C = 2.6 (see Fig. IIUII . This master curve is consistent 
with the scaling ansatz in the weakly perturbed regime 
[Eq. (|9I11() ] as shown in the figure. 

In the limit of strong chaos it is theoretically expected 
that LT^{tcs) = Lat [Eq. lO and l(T^ ]. and hence that 
the effective age of the system should only be given by 
the overlap length Tat and not by the wait time t^. 
Our study is however strongly limited by the experimen- 
tal time window. The upper limit 10** — 10^ s is set by 
how long we can wait for our experiments to finish, while 
the lower limit tmin is set by the cooling/heating rate 
and the time needed to stabilize the temperature (see 
Appendix IB 2|l . For large AT > 0.7, ipeak is saturated 
to imin (corresponding to Lnim) and obviously such val- 
ues of ipcak cannot be used in the scaling plot in Fig.lTUl 
Tat cannot be observed directly in this regime, but the 
fact that Tat < ^min in itself give evidence for strong 
chaos within the experimental time (length) window. 

Finally, we will make some comments on the validity of 
the scaling presented in Fig. ^| The quality of the scal- 
ing does not change significantly when altering the values 
of the parameters (t„i = 10"^^ s, Tg = 32.8 K, ziy = 7.2, 
ip — 1.2, J — Tg, and ly = 1.1 from Ref. 28), with one 
exception — symmetry between positive and negative T- 
shifts is obtained only if ipi' « 1.3. The x- and y-scale 
are completely arbitrary. We have intentionally chosen 
the constant a so that the data appear to be rather close 
to the strong chaos regime. 



B. Bond shift simulations 

We now present results of bond-shift simulations on 
the ±J EA model introduced in section III Al Two sets 
of bonds J^A and jTs are prepared as explained in section 
IIIBI Namely the set of bonds jTs is created from the 
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FIG. 8: (Color online) x" vs time measured for positive and negative T-shift experiments, (a) The Ag(ll at% Mn) sample is 
aged at Ti = 29.95, 29.9, 29.8, 29.7, 29.6 K for t„ = 10 000 s before changing the temperature to T™^ = 30 K. (b) It is aged 
at T, = 30.1, 30.2, 30.3, 30.4, 30.5 K for U = 1000 s before changing the temperature to = 30 K. (c) The Feo.sMno.sTiOs 
sample is aged at Ti = 18.8, 18.5, 18.0, 17.0, 16.0 K for t„ = 10 000 s before changing the temperature to T™ = 19 K. (d) It is 
aged at Ti = 19 K for tw = 1000 s before changing the temperature to Tm = 18.8, 18.5, 18.0, 17.0, 16.0 K. The thick lines are 
the (reference) isothermal aging curves starting from ty, -\- 1 = Q and -\-t = t^. The insets show x"{T^) vs t + teff with t^s 
determined from ZFC relaxation experiments. / = 510 mHz. 



set by changing the sign of a small fraction p of the 
bonds randomly. The protocol of the simulation is the 
following: a system with a certain set of bonds is 
aged for a time tw, after which the bonds are replaced 
by and the relaxation of the spin auto-correlation 
function 

CzFC {i + {l/N)Y,{S,{t^)S,{t + t^)) , (23) 

i 

where i runs over the N Ising spins Si in the system, 
is recorded. The bracket (. . .) denotes the averages over 
different realizations of initial conditions, thermal noises 
and random bonds. The subscript "ZFC" is meant to em- 
phasize that this auto correlation function is conjugate 
to the ZFC susceptibility: if the fluctuation dissipation 
theorem (FDT) holds (1 - C-i-Fc{t)){J /T) becomes iden- 



tical to the ZFC susceptibility. The relaxation rate S{t) 
is extracted by computing the logarithmic derivatives nu- 
merically, 

5(t) = -dCzFc(t + tw,tw)/log(t). (24) 

Usually the ZFC susceptibility is used to obtain the re- 
laxation rate. Here, we used the auto-correlation func- 
tion since it has much less statistical fluctuations. We 
note that FDT is well satisfied within what is called 
the quasi-equilibrium regime??, so that S(t) defined above 
yields almost the same effective time toff as obtained from 
the ZFC susceptibility. We remark that the autocorrela- 
tion function can be measured experimentally by noise- 
measurement techniques^. 

In Fig. ^] we show some data of relaxation rates ob- 
tained at T/J = 1.2 (T/Tg = 0.6) for bond-shift sim- 
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FIG. 9: (Color online) Relation between and toff in twin 
experiments - (Ti,T2) shown as pluses and (T2,Ti) shown 
as squares. (a) For the Ag(ll at% Mn) sample, Ti = 
(30- I ATI) K and r2 = 30 K with |Ar| = 0.05, 0.1, 0.2, 0.3, 
0.4, 0.5 K (0.015Tg). The solid line indicates fully accumula- 
tive aging Lti {ti) — (^2), calculated assuming logarithmic 
domain growth [Eg. IA2I . (b) for the Feo.sMno.sTiOs sample, 
Ti = (19 - |Ar|) K and r2 = 19 K with |AT| = 0.2, 0.5, 1.0, 
1.5 K (0.064rg). 



ulations with wait times tw = 10^, 10'^, 10^ and various 
strength of the perturbations A J/ J ~ ^/p with p in the 
range 0-0.16. For relatively small p (< 0.05), it can be 
seen that the peaks in the relaxation rate S{t) become 
broader either by increasing p or Simultaneously, with 
increasing p, they become somewhat suppressed and their 
positions are slightly shifted to shorter times compared to 
the peaks of the reference curves for p ~ 0.0 [Fig. lllf a)]. 
At larger p {> 0.05), different features can be noticed. 
The relaxation rate S{t) still becomes broader by in- 




0.2 0.4 0.6 0.8 

T ^ w' AT 



FIG. 10: (Color online) Scaling plot of L^s with Lat = 
Lo(a|Ar|/rg)"^/'^ with a = 6 and 1/C = 2.6. The fit is due to 
the scaling ansatz for the weakly perturbed regime [Eq. 1)11^ ] 
with c=0.4. The deviation from accumulative aging is shown 
in the inset and the line is the fit to the scaling ansatz for the 
weakly perturbed regime. (See Fig. ll2l for the corresponding 
scaling plot of the data of bond-shifts in the 4 dim EA model.) 



creasing but tends to saturate to some limiting curve. 
By increasing the strength of perturbation p further, not 
only the peak position of S{t) is shifted to shorter times, 
but the shape of S{t) again becomes narrower. Remark- 
ably, these features are very similar to experimental data 
where AT is varied. The effects of temperature pertur- 
bations shown in Fig. showed considerable broadening 
of S{t) while Fig. [7|showed narrowing of S{t). 

The results can be qualitatively interpreted according 
to the picture presented in Sec. IIIDl We know that the 
dynamical length scales Lt(0 do not vary much within 
the feasible range of time scales t„ (see Fig. while 
the overlap length Laj{p) oc ^/p"^^'' given in Eq. Q 
varies appreciably with the strength of the perturbation 
p. The saturation of the dependence can be inter- 
preted to show that with large enough p the strongly 
perturbed regime of the chaos effect enters the numerical 
time (length) window. The broadening of S{t) suggests 
that the order parameter [Eq. [2| does not have its full 
amplitude, in other words the domains are noisy or ghost 
like. This noise is progressively eliminated starting from 
the small defects and give rise to the excessive response, 
as discussed in Sec. Ill Dl On the other hand, the narrow- 
ing of S{t) at larger p > 0.05 suggests that the overlap 
length L/\j{p) has become smaller than Lxitw) and even 
approaches the minimum length scale Lq ^ I. Thus the 
excessive response decreases as the effective domain size 
[Eq. ijni) is reduced with increasing p and finally disap- 
pears in the strongly perturbed regime. Interestingly, 
this behavior resembles the results from our T-shift ex- 
periments on the Ag(ll at% Mn) sample. There, a con- 
siderable narrowing of the peak in S{t) occurred for large 
temperature shifts AT > 0.6 K (see Fig. [Tj), from which 
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FIG. 11: (Color online) The relaxation rate S{t) = — dC(t + tw, iw)/ log(t) of the 4DEA model after different waiting times 
with bond shifts of various strength p at temperature T = 0.6Tg. 



we concluded that the overlap length had become as small 
as the lower limit Lmin induced by the finiteness of the 
heating/cooling rate and the time required to stabilize a 
temperature in experiments. 

Let us turn to a more quantitative analysis similar to 
that of the temperature perturbation results on Ag(ll 
at% Mn) in Fig.^| We first determine the effective time 
tcff from the peak position ipcak of S{t) (see footnote for 
details^"). Then the effective domain size is obtained as 
Lctf — LT{tctf), using th e data of the dynamical length 
Lxit) obtained in Refs. '63*69' to convert time scales to 
length scales (see Fig. l24f) . The overlap length was calcu- 
lated from L/\j(p)/Lq ~ 0.1^^^^^ (Eq. assuming 
the chaos exponent to be C = 0.9. The value of the chaos 
exponent C, of the present 4-dim EA Ising model reported 
in earlier works varies as O.SE^^' and l.Sii. Here we as- 
sume C = 0.9 but small variations of the chaos exponent 
do not affect significantly the results reported below. 

We are now in position to examine the theory pre- 
sented in section III CI and IIIDI Equation © suggests 
that all data should collapse onto a master curve by plot- 
ting Lcff/^Ajb) vs Lt{K)ILi^j{p). Fig. m shows the 
resulting scaling plot. The scaling works perfectly well 
including all data from the two different temperatures 
TjJ = 1.2 and 0.8 at p < 0.05, which implies that the 
data collapse on a universal master curve. A fit accord- 
ing to the scaling ansatz for the weakly perturbed regime 
LT{iw)/La <C L^j{p) is also shown. The correction part 
Lcs/Laj{p) — Lxitw)/ L/^j{p) to the accumulative limit 



is plotted in the inset. It can be seen that the correction 
term is proportional to {LT/{tw)LAj{p))^'' with ( = 0.9, 
which is in perfect agreement with the expected scaling 
behavior for the weakly perturbed regime L ^ L^jip) 
(see Eq. (|ll|l '). In the above scaling plot we excluded 
data for p > 0.05 where tcs has become too small. As 
was shown in Fig. 1111 S{t) becomes narrower at these 
larger values of p, which suggests that the lower limit 
of the length scales Lq now comes into play explicitly. 
The scaling ansatz Eq. (|9I12|I should not work in such a 
regime. 



V. TEMPERATURE AND BOND CYCLINGS 

In this section we will investigate the "memory" that 
survives even under strong temperature or bond pertur- 
bations. 



A. Temperature-cycling experiments 

In Sec. IIV Al we found strong evidence that for the 
Ag(ll at% Mn) sample our experimental time window 
lies in the strongly perturbed regime, i.e. Lat < -^min, 
in the case of large enough temperature shifts (|Ar| > 
1 K). For the Feo.sMno.sTiOs sample on the other hand, 
the strongly perturbed regime was not reached within the 
temperature range and time window of our experiments. 
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FIG. 12: (Color online) Test of the scaling of Les after bond- 
shifts in the 4DEA model. The straight line in the main 
figure is the no-chaos limit. The fit is due to the scaling 
ansatz for the weakly perturbed regime Eq. with Z/aj(p) = 
O.ly'p"^'''' with C, — 0.9. T he dyn amical length Lrit) is due to 
the data obtained in Refs. I63l69l Thus, there are essentially 
zero fitting parameters. The correction part to the no-chaos 
limit is shown in the inset, where the straight line is the power 
law with exponent 2(^. See the corresponding scaling plot in 
the case of the temperature-shift experiments on the Ag(ll 
at% Mn) sample shown in Fig. 1101 

With this knowledge in mind, we can for the Ag(ll at% 
Mn) sample, focus on how the SG heals after a negative 
T-cycling into the strongly perturbed regime and make 
comparisons to the ghost domain scenario presented in 
Sec. in 

1. One-step temperature- cycling 



temperature 




FIG. 13: (Color online) Schematic representation of a one- 
step temperature cycling experiments according to the pro- 
tocol rm(twi) Tm + Ar(tw2) -» Tm. Whcu retumiug to 
Tm a short waiting time fws = 3 s is needed, before applying 
the magnetic field and recording the ZFC relaxation, in or- 
der to ensure thermal stability. In ac experiments x(i) is also 
recorded during the cycling. 

In a one-step temperature cycling experiments (see 
Fig. I13|) , the sample is first cooled to Tm and aged there 



a time fwi, the temperature is subsequently changed to 
Tm -|- AT where the sample is aged for a time t^^ (Per- 
turbation stage) and then the temperature is put back to 
Tm (healing stage). After a short wait time t^s to ensure 
thermal stability at Tm, the magnetic field is switched 
on and the magnetization MzFcit) is recorded, or the ac 
susceptibility is recorded continuously during the cycling 
process. 

A negative one-step T-cycling experiments (AT = 
—2 K) measuring the out of phase component of the ac 
susceptibility is shown in Fig.^ Results of such measure- 
ments with = 3000 s are shown in Fig.^j The aging 
at Tm -|- AT has been cut away in this figure and only 
the aging at Tm is shown. It can be clearly seen that the 
aging at Tm + AT introduces a considerable amount of 
excessive response, which increases with increasing t^^ . 
In the ghost domain scenario the excessive response is 
attributed to the introduction of noise in the ghost do- 
mains by the aging at the temperature T + AT. This 
yields a reduction of the order parameter [c.f. Eq.EI so 
that the recovery time free corresponds to the time scale 
at which the order parameter is recovered and hence the 
excessive susceptibility disappears [c.f. Eq. |^. From 
Fig. El the recovery times ircc are found to be of or- 
der 0(10^ - lO"*) s. If the T-cyclings would have kept 
the system in the weakly perturbed regime, the recov- 
ery times would become t^^^^^ = 0.04, 0.1, 0.3, 0.9 s for 
= 30, 300, 3000, 30 000 s according to Eq. (O and 
the growth law Eq. (|A2|) with the same parameters as in 
Sec. lIV A"4l Consistent with the prediction in Sec. lIIE2l 
the observed values of t^cc are several orders of magni- 
tude larger than t^cc^- However, the dependence of 
iroc is weaker than expected from Eq. 1201 indicating that 
corrections to the assymptotic formula are important on 
the experimental length scalespZS, Finally, let us note that 
a similar observation of anomalously large recovery times 
was made in a recent study by Sasaki et alS 

The ZFC magnetization has been measured after neg- 
ative one-step T-cyclings on the Ag(ll at% Mn) sam- 
ple with Tm 30 K and AT = -1.5 K. Figure IT^ 
shows the ZFC relaxation data; Type I: the initial wait 
time iwi is varied while the duration of the perturba- 
tion = 3000 s is fixed. Type II: the initial wait time 
is fixed to t^^ = 3000 s while the duration of the per- 
turbation is varied. Isothermal aging data are also 
shown in these figures for comparison. As seen in the 
figures, the magnetization always exhibits an enhanced 
growth rate at observation times around tmin after the 
cycling and in addition a second enhanced growth rate 
at observation times around iwi which are manifested 
as two peaks in the relaxation rate S{t). The peak of 
S{t) around tmin can be attributed to rejuvenation ef- 
fects and the peak around i^i to memory effects. It can 
be seen that by increasing the duration of the perturba- 
tion tw2 the height of the 2nd peak of S{t) at around 
twi dramatically decreases, but the peak position itself 
does not change appreciably. By studying the magneti- 
zation curve and comparing it to the reference curve of 
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FIG. 14: (Color online) x"(^) time at Tm for experiments 
with a negative T-cycling of AT = -2 K (Tm + AT = 28 K); 
t„i = 3000 s and = 30, 300, 3000, 30 000 s (bottom to 
top). The thick (black) lines represent the reference isother- 
mal aging at Tm, one of these curves is shifted a quantity 
twi in time. The inset shows [x"(*) — x"of (^)]/Xr'of (*) for the 
transient part of the susceptibility after the T-cycling. x"(*) 
during the all stages of the T-cycling are shown in Fig. |2 for 
= 3000 s. tj/27r = 510 mHz. 



isothermal aging (with wait time — iwi ) , it can be 
appreciated that the cycling data eventuaUy merges with 
that of the isothermal aging curve (ahhough it is outside 
the time scales of our measurements). The time scale of 
the merging appears to become larger for longer duration 
of the perturbation t^^ . 

Within the ghost domain picture discussed in Sec. m 
this two stage enhancement of the relaxation rate can be 
understood as follows. The aging at the second stage in- 
troduces strong noise and reduces the amplitude of the 
order parameter in the ghost domains Lt^ (t^i ) grown at 
Tm during the initial aging. The system is hence strongly 
disordered with respect to the equilibrium state at T^, 
but the original domain structure is conserved as a bias 
effect (the order parameter prcm > 0). During the third 
stage (healing stage) the aging called inner-coarsening 
starts, i.e. new domain growth starting from an almost 
random state although with weakly biased initial condi- 
tion. Hence, when the magnetic field is switched on in 
the healing stage, the inner-coarsening has already pro- 
ceeded for the time tmin- This is reflected by the 1st peak 
of S{t). During the heahng stage, the strength of the 
bias keeps increasing so that the noise (minority phases) 
within ghost domains is progressively removed. The 2nd 
peak of S{t) corresponds to the size of the ghost domain 
Lt^ (^wi ) , which itself continues to slowly expand in the 
healing stage (outer-coarsening). Thus, this represents 
the memory of the thermal history before the pertur- 
bation. An illustration of this noise-imprinting-healing 
scenario is given in Fig. |3| However, the increase of the 
bias is so slow that the recovery time ^rc™"^ order 
parameter can be extremely large as given in Eq. (|20|l . 
Then, the order parameter within a ghost domain may 



not be recovered fully until the ghost domain itself has 
grown appreciably in the healing stage. Probably this 
explains the fact that the 2nd peak of S{t) is greatly 
suppressed (but not erased) by increasing the duration 
of the perturbation t^^, which also increases the recov- 
ery time i^*™"*^- 



2. Two-step temperature-cycling 

Finally, two-step T-cyclings are studied in order to in- 
vestigate the anomalous multiplicative effects of noise an- 
ticipated by the ghost domain picture [see Sec. Ill ES] . In 
this protocol an extra T-shift is added to the one-step 
temperature cycling procedure shown in Fig. 1131 the sam- 
ple is cooled to Tm where it is aged a wait time (initial 
aging stage), subsequently the temperature is shifted to 
Ti = T,n + ATi for a time t^^ (1st perturbation stage), 
then shifted to T2 = Tm -I- AT2 for a time iwg (2nd per- 
turbation stage) and finally changed back to Tm (heal- 
ing stage) where Mzfc(0 is recorded. As illustrated in 
Fig. ^1 one can make two different kinds of 2-step-T- 
cycling experiments (with Ti,T2 < Tm); involving either 
a positive (T2 > Ti) or a negative (T2 < Ti) T-shift 
between Ti and T2. 

In Fig. El ^ set of data using the two-step 
temperature-cycling protocol with Tm = 30 K and i^i — 
= = 3000 s are shown, together with refer- 
ence data for one-step cycling experiments and isother- 
mal aging experiments at Tm. It can be seen that 
the data of the N-two-step experiment with (Ti,T2) = 
(29K, 27K) is slightly more rejuvenated than the corre- 
sponding one-step cycling with Tm + AT = 29 K and 
= 3000 s, while the data of the P-two-step exper- 
iment with (Ti,T2) = (27K,29K) is much more reju- 
venated. Furthermore, the data of the P-two-step ex- 
periment with (Ti,T2) = (28K,29K) is strikingly more 
rejuvenated, so that the Mzfc(^) curve is close the one- 
step cycHng with Tm + AT = 29 K and t^^ = 30 000 s. 
This may appear surprising, since the total duration of 
the actual perturbation is only -f t^^ = 6000 s. 

The anomalously strong rejuvenation effect after the 2- 
step cycling can be understood by the ghost domain pic- 
ture as the multiplicative effect of noise given in Eq. H22|l . 
One should however take into account the renormaliza- 
tion of the overlap length Tat LminivT,T) due to 
finiteness of heating/cooling rates discussed in Sec. IIIFI 
Naturally, the latter effect can significantly or even com- 
pletely hide the multiplicative nature of the noise in- 
troduction as appears to have happened in a previous 
studyi^ To reduce such "disturbing" effects as much 
as possible, one should use fast enough heating/cooling 
rates. It should also be recalled that in the present exper- 
iments, the heating is almost 10 times faster than cool- 
ing which implies that the renormalized overlap length 
imin(i'T,T) is larger for cooling than for heating. This 
may explain the apparent asymmetry of the negative and 
positive two-step T-cyclings in Fig. 1171 The weaker reju- 
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FIG. 15: (Color online) ZFC relaxation curves (MzFc(i) and S{t)) obtained after a negative T-cycling of AT = -1.5K (Tm = 
30 K; + AT = 28.5 K); Type I: = 30, 300, 3000, and 30 000 s and = 3000 s; Type II: = 3000 s and = 30, 
300, 3000, 30 000 s. Isothermal aging recorded at Tm = 30 K are added for comparison in dashed lines; Type I: tw = iwi; Type 
II: tw = 3 s and tw ~ 3000 s. (See later Fig. 1181 for the corresponding data of the one-step bond-cycling in the 4d EA model.) 
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FIG. 16: Schematic illustration of a) positive {T2 > Ti) and 
b) negative {T2 < Ti) two-step-T-cycling. 



venation effect observed in the P-two-step measurement 
{Ti,T2) = (27K,29K) compared with (28K,29K) can 
simply be attributed to the temperature dependence of 
the domain growth law Eq. (|A2|I . 



B. Bond-cycling simulations 

1. One-step bond cycling 

For a one-step bond-cycling simulation on the ± J EA 
model, we prepare two sets of realizations of interaction 
bonds J"^ and as before. The set of bonds J7b is 
created from J7a by changing the sign of a small frac- 
tion p of the latter randomly. In order to work in the 



strongly perturbed regime we choose p — 0.2, since the 
analysis in the previous section (see Fig. [T^ ensures that 
almost the whole time window of the simulations lies well 
within the strongly perturbed regime with p = 0.2. We 
also made simulations with weaker strength of the pertur- 
bation p = 0.05, for which time scales greater than 10'^ 
MCS belongs to the strongly perturbed regime as can 
be seen in Fig. ^1 and obtained qualitatively the same 
results but with larger statistical errors. The working 
temperature is fixed to T/Tg = 0.6 throughout the simu- 
lations and the strength of the probing field is h/J = 0.1, 
which is small enough to observe linear response within 
the present time scales 

The procedure of the one-step bond-cycling is the fol- 
lowing. First the system is let to evolve under J'^ for a 
time at temperature T starting from a random spin 
configuration. Then, the bonds are replaced by and 
the system is let to evolve another time interval ■ Fi" 
nally, the bonds are put back to J'^ and the system is let 
to evolve. After a time interval 7 a small magnetic field 
h is switched on and the growth of the magnetization is 
measured to obtain the ZFC susceptibility 

XzFc(<) = (J//t)(l/iV)) y^(5't(t + 

)> (25) 
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FIG. 17: (Color online) ZFC relaxation curves obtained af- 
ter negative two-step T-cyclings. Two-step- T-cycling experi- 
ments r„(fwi) ^ Ti (Us) ^ T2 (tws) ^ Tm with T„ = 30 K 
and = = = 3000 s are shown. A negative 
T-shift in Ti r2 is made with {Tx,T2) = (29K,27K) 
(diamonds), and positive T-shifts in T\ T2 are made 
with (Ti.Ta) = (28K,29K) (circles), (Ti,T2) = (27K,29K) 
(pulses). The isothermal aging with tw = 3 and 3000 s 
(dotted lines) at T-m = 30 K and one-step T-cycling exper- 



Tn, + AT {U 



Tm with Tm 



30 K, 



iments Tm(twi) 
Tm -I- AT = 29 K, t„2 = 3000 and 30 000 s (dashed lines) are 
shown for comparison. (See Fig. 1191 for the corresponding 
data of the two-step bond-cycling in the 4d EA model.) 



linear susceptibility xzfc(0 should have the so called 
weak long term memory (WLTM) property!, stating that 
an integral of linear responses during a finite interval of 
time finally disappears at later times, whereas the auto 
correlation does not have such a property. 

In Fig. ^1 we show a data set labeled "type-I" , where 
the initial wait time is varied while the other time 
scales are fixed. Another data set labeled "type-II" is 
also shown, where the duration of the perturbation t^^ 
is varied while the other time scales are fixed. The cor- 
responding data in the case of temperature-cyclings are 
shown in Fig.^] In all data in Fig.^l there is a common 
feature that the ZFC susceptibility xzfc (i) and the con- 
jugate auto correlation function Czfc(*) exhibit two-step 
relaxation processes which can be naturally understood 
as the inner- and outer-coarsening discussed in sectionlTll 
In the figures the data of the reference isothermal aging 
without perturbations of the ZFC susceptibility Xo(^; ^w) 
and the autocorrelation function Co(t, iw) are shown for 
comparison. 

Quite remarkably, the generic features of the behav- 
ior of the ZFC susceptibility xzFc(i) is the same as in 
temperature-cycling experiments. First, there is an ini- 
tial growth of the susceptibility which appears to be close 
to the curve of the reference isothermal aging Xo{t,t^) 
with wait time = ■ This feature can be nat- 
urally understood to be due to the inner-coarsening. 
Then, there is a crossover to Xol^i^w) with wait time 
= iwi + which can naturally be understood to be 
due to the outer-coarsening. 

Correspondingly, and as expected, the auto-correlation 
function Czfc (^) exhibits a similar two-step relaxation as 
XzFc(^)- It initially follows the reference curve Co(t, iw) 
of = t„3 (inner-coarsening) and makes a crossover 
to slower decay which depends on + iwa (outer- 
coarsening) at later times. This auto-correlation function 
was studied in bond-cycling simulations of the spherical 
and Ising Mattis model in Ref. |22| with rejuvenation put 
in by hand, where essentially the same result as here 
was obtained. Thus, the present results support that the 
same mechanism of memory is at work in the spin-glass 
model. 



where t is the time elapsed after the magnetic field is 
switched on. We also measured the conjugate auto- 
correlation function to the ZFC susceptibility in the same 
protocol but without applying a magnetic field, 

CZFC(0 = + ^W3 + ^W2 + twi , + +twi), (26) 

where C{ti,t2) — {^/N) J^i Si{ti)Si{t2) is the spin auto- 
correlation function. Again, the subscript "ZFC" is put 
to emphasize that this auto correlation function is con- 
jugate to the ZFC susceptibihty if the FDT holds. We 
expect both quantities to reflect the inner- and outer- 
coarsening discussed in Sec. ^ but there are also ap- 
parent differences. Firstly, the FDT is expected to be 
violated in the outer-coarsening regime»£? Secondly, the 



2. Two-step bond-cycling 

For the two-step bond-cycling, we consider that the 
procedure J"^ ^ -> is the same as the 

one-step bond cycling except that some time is spent 
at J'^ before coming back to . The bonds of and 
are prepared as in the one-step cycling case, i.e the 
set of bonds is created from by a perturbation 
of strength p. The 3rd set of bonds J'^ is created from 
by a perturbation of strength p. Note, that this cor- 
responds to create J'~^ out of by a perturbation of 
strength p' = 2p{l — p). Here, we again use p = 0.2 and 
thus p' — 0.32 in order to work in the strongly perturbed 
regime. The temperature is again fixed to T/Tg = 0.6 
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FIG. 18: (Color online) ZFC susceptibility and the corresponding auto-correlation function in the 4DEA model after bond- 
cyclings. The filled squared are the data obtained after bond-cyclings with Type I: ~ 10^, 10^, 10'', 10^ (MCS) (xzfc from 
top to bottom CzFC from bottom to top), t^^ = 10, and ^3 = 10 (MCS); Type II: t^-^ = 10* (MCS), t^^ = 10,40, 160,640 



twi = 10" 

and 10^ (MCS) (xzfc from top to bottom Czpc from bottom to top), and t^^ — 10 (MCS). The solid lines are the reference 



isothermal aging data (a) Xo(i, iw) (b) Co{t,t„) with t„ 
the corresponding temperature-cycling experiment.) 



and the dotted lines those with tw = twi -I- tw3- (See Fig. llSlfor 



throughout the simulations and the strength of the prob- 
ing field is h/J = 0.1. 

In Fig.^1 we show the ZFC susceptibihty xzfc(0 ^^'^ 
the conjugate auto correlation function Czfc(0 after the 
two-step bond cyclings J"^ which is 

compared with the data of one-step bond cyclings 
J'~^ J^. It can be seen that the effect of the two step 
perturbations with t^^ = — 10 (MCS) is stronger 
than the one step perturbation with t^^ = 20 (MCS). 
Moreover, two step perturbations with t^^ = t^,^ = 80 
(MCS) is as strong as the one step perturbation with 
= 640 (MCS). 



VI. MEMORY EXPERIMENTS 

This section discusses memory experiments, which 
probes nonequilibrium dynamic under continuous tem- 
perature changes and halts, using low frequency ac sus- 
ceptibility and ZFC magnetization measurements. Such 
experiments have become a popular tool for investiga- 
tions of memory and rejuvenation effects in various glassy 
systems, for example interacting nanoparticles^^ poly- 
mer glasses,^** and granular superconductorsi^. It can 
however be difficult to interpret the experiments, since 
memory and rejuvenation effects are mixed with cool- 
ing/heating rate effects in a nontrivial way. 



The above result can hardly be understood by a naive 
length scale argument. It resembles the result of the 
corresponding two-step temperature cycling experiments 
discussed in Sec. IV Al and is consistent with the expec- 
tation in the ghost domain scenario, which predicts mul- 
tiplicative effects of perturbations in the strongly per- 
turbed regime (see Eq. H22|l ). 



A. ac memory 

Results of ac-susceptibility memory experiments are 
shown in Fig. 1201 the ac susceptibility is measured on 
cooling and on the subsequent reheating. Measurements 
are made both with and without temporary stop(s) at 
constant temperature on cooling. In the figure, x"{T) 
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FIG. 19: (Color online) The relaxation after two-step bond- 
cycling ^ ^ j'-' ^ . The target equilibrium 
state is cycled as (10'' (MCS)) ^ (tw^ (MCS)) ^ 
J"^ (fw3 (MCS)) ^ J"^ (f (MCS)). In the figures the dotted 
lines are the reference data of one-step bond-cycling (10* 
(MCS)) ^ J"^ (fw2 (MCS)) J"^ (t (MCS)) with = 
20, 40, 80, 160, 320, 640 (MCS) which vary from bottom to top 
in (a) and from top to bottom in (b). (See Fig. 1171 for the 
corresponding two-step temperature-cycling experiment.) 



is plotted vs. temperature for the two samples. It 
is interesting to note that even without a temperature 
stop, we observe differences between Ag(ll at% Mn) and 
Feo.sMno. 5X103 as regard the relative levels of x"(^) 
measured on cooling and reheating (the "direction" of 
measurement is indicated with arrows on the figure). In 
the case of Ag(ll at% Mn) , the heating curve lies signifi- 
cantly above the cooling curve (except close to the lowest 
temperature) . Such a behavior can only be explained by 
strong rejuvenation processes during the cooling and re- 
heating procedure. In the case of Fco.sMno.sTiOa , on 
the other hand, the susceptibility curve recorded on re- 
heating lies below the corresponding cooling curve, in- 
dicating that some equilibration of the system is accu- 
mulative in the cooling/reheating process. By making 
one or two temporary stops during the cooling processes, 
memory dips are introduced in the susceptibility curves 
on reheating as seen in the main frames and illustrated 
as difference plots in the insets of Fig. 1201 These figures 
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FIG. 20: (Color online) x" vs temperature with temporary 
stops at (a) = 30 K and Ts^ = 24 K and (b) %^ = 20 K 
and = 16 K; t^i ~ ts2 = 3000 s. These values of corre- 
spond to T/Tf — 0.9 and 0.7 for both samples, where Tf is the 
freezing temperature.'^^ Filled symbols are used to represent 
the curves measured on cooling, and open symbols the curves 
measured on heating. The reference curves (without stops) 
are shown as lines, the arrows indicate the cooling respective 
the heating curve. The insets show the difference plots for 
double stop experiments (open symbols) and associated sin- 
gle stop experiments (lines) measured on heating. uj/2tt = 
510 mHz and ^ ~ 0.005. 



illustrate one more marked differences in the behavior 
of the two samples: the memory dips are wider for the 
Feo.sMno. 5X103 than for the Ag(ll at% Mn) sample. 



B. ZFC memory 

ZFC memory experiment s ^^' i ^^ will here be used to 
further elucidate the differences between the two sam- 
ples. Results of single stop ZFC memory experiments for 
the Ag(ll at% Mn) and Feo.5Mno. 5X103 spin glasses are 
shown in Fig. [2] In both cases, the sample is cooled in 
zero magnetic field and the cooling is temporary stopped 
at Ts/Tf = 0.8 for ts = 3000 s (main frame). Here Tf 
is the freezing temperature of the ZFC magnetizationiS 
Xhe cooling is subsequently resumed and the ZFC magne- 
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FIG. 21: (Color online) ZFC susceptibility vs T/Tf for (a) the 
Ag(ll at% Mn) sample and (b) the Feo.sMno.sTiOs sample. 
The ZFC susceptibility is measured after continuous cooling 
(filled symbols) and cooling with a temporary stop (open sym- 
bols) of 3000 s at Ts/Tt ~ 0.8 {n = 27 K for Ag(ll at% Mn) 
and Ts = 19 K for Feo.sMno.sTiOs ). The insets show the cor- 
responding difference plots ("stop curve" - reference curve), 
and additional results for 3000 s stops made at (a) Ts = 24- 
31 K and (b) = 16-21 K. Vcooi ~ 0.05 K/s and ~ 0.005. 





FIG. 22: (Color online) Difference plots of ZFC susceptibility 
vs T/Tf corresponding to single and double stop experiments, 
with one (or two) temporary stops for 3000 s at (a) Ts^ = 
30 K or/and T^^ = 24 K and (b) T^^ = 21 K or/and Ts^ = 
17 K. The single stop experiments are represented using filled 
markers, while open markers are used to represent the double 
stops experiments. Ucooi ~ 0.05 K/s and f^^at ~ 

0.005. 



double stop curvei^^ But, while for Ag(ll at% Mn) the 
two peaks are well separated, for the same separation in 
T/Tf, the single stop curves of Feo.sMno.sTiOs overlap, 
due to the larger width of the memory dips. 



tization recorded on reheating in a small magnetic field. 
A reference curve measured using the same protocol but 
without the stop is also recorded. The difference between 
corresponding reference and single memory curves are 
plotted in the inset, together with results obtained from 
similar measurements with stops at some other temper- 
atures. As seen in the main frames, the curves corre- 
sponding to the single stops lie significantly below their 
reference curves in a limited temperature range around 
Ts/Tf. In the associated difference plots, this appears as 
"dips" of finite width around the stop temperatures. It 
has been argued that such dips directly reflect the mem- 
ory phenomenon^ 

The memory dips appear much broader for the 
Feo.sMno.sTiOs sample than for the Ag(ll at% Mn) sam- 
ple. This can be seen even more clearly in the double stop 
dc-memory experiments shown in Fig. Two 3000 s 
stops are performed at T^jTi = 0.9 and T^jTf = 0.72 
during the cooling to the lowest temperature. The results 
of the corresponding single stop experiments at Tgj^ and 
Ts2 are included. For both systems, the sum of the two 
single stop curves (not shown here) is nearly equal to the 



C. Accumulative vs chaotic processes 

In the ghost domain picture, the size of domains at a 
given temperature T can be increased by aging at nearby 
temperatures (see Fig. However, noise is induced on 
the domains at T by the growth of domains at other 
temperatures outside the overlap region (c.f. Sec. Ill F'5|l . 
In particular the spin configuration subjected to contin- 
uous temperature changes with a certain rate vt is ex- 
pected to attain a domain size Tmin(?^T, 2^) at temper- 
ature T, due to the competition between accumulative 
aging and chaotic rejuvenation processes (as discussed 
in Sec. Ill F|l . Linin(i'T,r) is reflected on the magnetic 
response of the systems under continuous temperature 
changes; the larger Li-ain{vT,T) the smaller x"(T). In 
the data of the ac susceptibility measured under contin- 
uous cooling and reheating shown in Fig. 1201 we found 
that for the Ag(ll at% Mn) sample the ^'{T) curve 
on reheating lies above the one measured on cooling, 
while the opposite applies to the Feo.sMno.sTiOs sam- 
ple. These features suggest strong chaotic rejuvenation in 
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Ag(ll at% Mn) and much weaker in the Feo.sMno.sTiOa 
sample. This is quahtatively consistent with the obser- 
vations made in the temperature-shift experiments pre- 
sented in Sec. lIV Al that the overlap length for the Ag(ll 
at% Mn) decays faster with increasing AT than that of 
the Feo.sMno.sTiOa system. 



D. An apparent hierarchy of temperatures 

In a memory experiment, during a stop made at Ts 
for a time ts the size of the domains becomes LtS^s)- 
The ghost domains at nearby temperatures will also grow 
but only up to Lcff [Eq. Q], as illustrated in Fig. |2S1 
The min(LT^ (i^), L^j'^l'j^^_ji|) is the upper bound for 
Loff. When the cooling is resumed, the ac susceptibility 
curve merges with the reference curve because the overlap 
length becomes smaller than the minimum domain size 
Lmim which depends on the cooling rate.^'' On the sub- 
sequent reheating the domain sizes at the temperatures 
around Tg are larger than Lmin so that the susceptibility 
curve (ac or dc) measured on heating makes a "dip" with 
respect to the reference curve without any stop. 

Let us compare the schematic picture of length scales 
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FIG. 23: (Color online) A schematic illustration of the length 
scales explored in the Ag(ll at% Mn) sample by continuous 
cooling (and heating) with temporary halts at Ta\ = 30 K and 
Ts2 = 24 K for tsx — tsi = 10^ s. The effective domain size 
grown during the temporary halts at Ta for a time ta is given 
byi off — ^ C^T=\T-Ts\ F(LT,(t.)/LAT=|T-T,|) [Eq. It 
is bounded from above by the overlap length -t'AT=|T-Ts | • 
The scaling function F(x) — tanh(a;)(l — cx^'"/ cosh(a;)) inter- 
polates between the fit to the weakly perturbed regime (shown 
in Fig. ll()|l and the strongly perturbed regime limj^^cx) F{x) — 
1. Here all parameters for the growth law Lrit) [see Fig. 1241 
and the overlap length Lat are the same as in Sec. IIVA4I 
The continuous cooling and heating yields the minimum ef- 
fective domain size Lmin at all temperatures. Here it is simply 

assumed to be I/min = -f'T(imin) with imin = 100 Si^ 



for the Ag(ll at% Mn) sample shown in Fig. 1231 with 
the corresponding 2-stop memory experiment shown in 
Fig. 1201 and [221 We can see that the widths of the dips 
around Ts in the memory experiment correspond roughly 
to the widths of the temperature-profile of the effective 
domain size L^s at around Ts. The width of the mem- 
ory dips becomes broader at lower temperatures for all 
memory experiments both for the Ag(ll at% Mn) and 
Feo.sMuo.sTiOa samples. In the length scale picture it 
is also seen that the temperature profile of Lcff around 
Ts becomes broader at lower temperature, due to the 
temperature dependence of the growth law (see Fig. I24|l . 
From this scenario it is clear that a larger overlap length 
makes the weak chaos regime larger and hence the mem- 
ory dips broader. The observed differences between the 
width of the dips of the Feo.sMuo.sTiOs and Ag(ll at% 
Mn) samples may be attributed to such a difference in 
overlap length in consistency with the results shown in 
Fig. El 

The distinct multiple memories shown in Figs. 1^ and 
1221 could suggest some sort of "hierarchy of tempera- 
tures" . However, it is not necessary to invoke neither 
the traditional hierarchical phase space pictur^^ nor the 
hierarchical length scale picturo^i^'^i^^i^-^i'^^i'^'^i^^ to under- 
stand this multiple memory effect. Indeed, the domain 
sizes grown at the two stop temperatures are almost of 
the same order of magnitude since thermally activated 
dynamics does not allow significant hierarchy of length 
scales explored at different temperatures (as discussed in 
Appendix . Thus the scenarios of the memory effect 
which strongly relies on the assumption of hierarchy of 
length scalea^i^^i^^i'^-^i^^i'^^i^^ cannot explain the distinct 
memory dips. Without temperature-chaos, the temper- 
ature profile of Left becomes so broad that the mem- 
ory dips strongly overlap. Our estimates suggest that 
the sizes of domains grown at the two stop temperatures 
shown in Fig. [221are much larger than the overlap length 
between the equilibrium spin configurations at the two 
temperatures within the experimental time scales. Thus 
the memories imprinted at the two stop temperatures 
are significantly different from each other. Also, retrieval 
of such memories under strong temperature-chaos effect 
is possible within the ghost domain picture as discussed 
in Sec III El A crucial ingredient in experiments is the 
finiteness of the heating and cooling rate which yields 
the characteristic length scale Lmin, schematically shown 
in Fig. I2S1 As discussed in section Sec. IIIFI Lmin plays 
the role of a renormalized overlap length which leads to 
substantial reductions of the recovery times of memories. 

It should however be noted that much broader mem- 
ory dips are observed in experimental systems such as su- 
perspin glasses, for which experiments probe short time 
(length) scales so that the effect of temperature-chaos is 
negligible, and the memory dip is determined by freez- 
ing of smaller and smaller domains_on cooling in a fixed 
energy landscape-® (see also Ref. 23). Lastly, we note 
that the width of the memory dips give an indication of 
the strength of the temperature-chaos effect, but a bet- 
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ter estimation is given by the twin T-shift experiments 
discussed in Sec. IIVI 

VII. SUMMARY AND CONCLUSION 

Rejuvenation (chaos) and memory effects have been in- 
vestigated after temperature perturbations in two model 
spin glass samples, the Feg.sMno.sTiOs Ising system and 
the Ag(ll at% Mn) Heisenberg system, as well as after 
bond perturbations in the 4 dimensional EA Ising model. 
These effects are discussed in terms of the ghost domain 
picture presented in Sec. ^ 

• The ZFC relaxation is measured after a T-shift for 
the Feo.sMno.sTiOa and Ag(ll at% Mn) samples. 
By analyzing the peak positions of the relaxation 
rate S(t) using the twin T-shift protocol introduced 
in Ref . 1281 evidences of both accumulative and non- 
accumulative aging regimes in both samples were 
found (cf. Fig.EIl. The Ag(ll at% Mn) sample was 
found to exhibit stronger deviations from fully ac- 
cumulative aging with increasing |AT|/Tg than the 
Fco.sMno.sTiOa sample. A scaling analysis, per- 
formed on the data of the Ag(ll at% Mn) sam- 
ple fFig. llOl) . reveals increasing rejuvenation effects 
with increasing AT. These rejuvenation effects can 
consistently be understood in terms of partial chaos 
at length scales smaller than the overlap length 
Tat, as first proposed in Ref. [s^. However, data 
derived using larger perturbations |AT| > 0.6 K 
could not be used in the scaling analysis because 
the rejuvenation effect saturates due to the slow 
cooling/heating rates. This suggests the emergence 
of the strongly perturbed regime in the sense that 
Tat < ^min, where Tmin is the smallest observable 
domain size due to the slow cooling/heating. The 
overlap length can never be directly observed in ex- 
periments since it is hidden behind Tmin as can be 
seen in the schematic Fig. On the other hand 
some properties of the overlap length are obtained 
indirectly by the scaling in the weakly perturbed 
regime (Fig. ^j). 

• In the case of bond-shift simulations, the relaxation 
rate S(t) is found to show a similar behavior as in 
the T-shift experiments as shown in Fig. ^2 S{t) 
is initially broadened with increasing strength of 
the perturbation p, where also the scaling analy- 
sis presented in Fig. E| exhibits the emergence of 
corrections to the fully accumulative aging. The 
scaling ansatz Eq. (|9I11|I was shown to hold with 
only the chaos exponent ^ being a fitting parame- 
ter, a result that also gives further support to the 
corresponding analysis from T-cycling experiments. 
However, again the data with stronger perturba- 
tion (larger p) could not be used in the scaling be- 
cause the peak positions saturated to 0(1) (MCS), 
which is the minimum time scale. In such a regime. 



S(t) exhibits considerable narrowing with the peak 
at 0(1) (MCS). This can again be understood to 
be due to the emergence of the strongly perturbed 
regime in the sense that Tat ^ Lq where Tq is the 
unit of lattice spacing. 

• For the Ag(ll at% Mn) sample temperature 
changes |AT| > 1 K were shown to cause strong 
perturbations to the system. One and two-step 
negative T-cycling protocols were used in order 
to investigate the healing after such strong per- 
turbations. The recovery times after one-step cy- 
clings shown in Figs. El and E] were found to be 
anomalously larger than the trivial recovery times 
t7cc^ given in Eq. (|15|l (which could be evaluated 
using the growth law confirmed in Sec. IIV A4|l . 
Furthermore, the two-step cyclings data displayed 
in Fig. El show that the effects of perturbations 
made at two different temperatures can give rise 
to much stronger rejuvenation than only an addi- 
tive increase of the effects of single perturbations. 
These striking features are in agreement with ghost 
domain scenario fSec. Ill E|l . 

• In the bond-cycling simulations, a large strength 
of the perturbation, p — 0.2, was used to focus on 
the strongly perturbed regime. The healing pro- 
cess after one-step cycling simulations displayed in 
Figs. 1181 and and the two-step bond-cycling shown 
in Fig. 1191 were found to require anomalously large 
recovery times, in consistency with the results from 
T-cycling experiments and the predictions of the 
ghost domain scenario. It is also demonstrated in 
Fig. El that a "memory" of the history before the 
perturbation cannot be erased completely even if 
the duration of the perturbation is effectively longer 
than the duration of the preceding history. 

• It is proposed that the effects of finite heat- 
ing/coohng rates vt can be parameterized by a 
renormalized overlap length Tmin(fTjT')- In com- 
bination with a strong separation of time scales, 
this can lead to an apparent "hierarchy of temper- 
atures", as has been suggested earli er from exper- 
imental observations e.g. in Refs. I79l80i In the 
ghost-domain scenario however, the temperature 
chaos effect is the mechanism which allows distinct- 
ness of memories at each level of the "hierarchy" as 
illustrated in Fig. El This explains the two well 
separated memory dips seen in e.g. the memory 
experiment shown in Fig. 1201 

To conclude, dynamical properties of the Ising 
Fco.sMno.sTiOa and the Heisenberg Ag(ll at% Mn) spin 
glasses subjected to temperature changes and the 4 di- 
mensional Edwards Anderson Ising spin glass model sub- 
jected to bond changes are examined and compared with 
each other in detail. The temperature-shift/cycling ex- 
periments and bond-shift/cycling simulations show re- 
markably similar features suggesting a common mecha- 
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nism of the rejuvenation and memory effects. The de- 
tailed features of the rejuvenation effects after tempera- 
ture/bond shifts are found to agree with the anticipated 
crossover from weakly to strongly perturbed regimes of 
the chaos effects. Quantitative differences in different 
systems can be attributed to differences of the magni- 
tude of the overlap length. Anomalously large recovery 
times of the memories are found to be required in the 
one and two-step temperature/bond cycling experiments 
when performed into the strongly perturbed regime, in 
agreement with the ghost domain scenario. 
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APPENDIX A: SEPARATION OF LENGTH AND 
TIME SCALE 

In this appendix we summarize important properties of 
activated dynamics that governs the growth of domains 
in spin glasses. At mesoscopic levels, the dynamics of a 
spin glass at temperatures below Tg is governed by nu- 
cleation of droplet like excitations.^* The energy barrier 
associated with a droplet of size L is assumed to scale as 
Ex, - /\{T){L / Lq)'!' with > 0. Then the time needed 
to nucleate a droplet by thermal activation becomes 



?/T„, with T„,= 10 (sec) 



tl(T) =To(T)exp 



A(T) / L 



(Al) 



where the effects of critical fluctuations are taken into ac- 
count in a renormalized way in the characteristic energy 
scale A(T) for the free-energy barrier and the charac- 
teristic time scale to(T) for the thermally activated pro- 
cesses. They scale as A(T)/J - e''"' and To{T)/Tn-, - 



{^{T)/LqY - |e|-^'^ with e = T/Tg - 1. The microscopic 
time scale is ^ h/ J ~ 10"^'^ s in atomic spin glasses 
and one Monte Carlo Step (MCS) in Monte Carlo simu- 
lations. J ~ Tg sets the energy unit, z is the dynamical 
critical exponent and v the exponent for the divergence 
of the correlation length. The importance of accounting 
for critical fluctuations has been realized in analyzes of 
recent simulations^SiSiSS and experimentsiSSiSS 

From Eq. (jAlj) it follows that within a time scale t a 
droplet excitation as large as 
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FIG. 24; (Color online) The dynamical length scales rele- 
vant in our experiments and simulations, (a) A plot of the 
growth law Eq. IIA21 with parameters determined for a Ag(ll 
at% Mn) sample in Ref. (23 from a scaling analysis of the 
relaxation of the ac susceptibility in isothermal aging in the 
range 20 — 30 K. The growth law at the critical tempera- 
ture L{t)/Lo = {tlr^YI'' {z = 6.5) is also shown. (The 
possible 0(1) prefactor in front of Eq. llA2l l and the critical 
growth law is not known.) The unit of time is chosen to be 
T"m ~ h/J ~ 10~^^ s. The experimental time-length scale is 
the area surrounded by the box. (b) The size of the domains 
of a 4 dimensional EA Ising spin glass model determined di- 
rectly in a previous numerical simulation— monitoring the 
spatial correlation function between two real replicas under- 
going isothermal aging. The dotted line is the power law for 
the critical regime L{t)/Lo = {t/rm)^^^ with z = 4.98. 



can be thermally activated. At finite time scales there 
must be corrections to the asymptotic form Eq. (|A2(I due 
to critical fluctuations'^'^'^^ as well as logarithmic correc- 
tion terms to the energy barriers^i but the actual forms 
of the corrections are not yet known in spin-glasses. 

An immediate consequence of activated dynamics is an 
extremely wide separation of time scales with tempera- 
ture. On the other hand the variation of length scales 
with temperature is very mild (typically less than one or- 
der in magnitude). Let us consider two arbitrarily close 
temperatures T and T -I- AT. From Eq. I|A1|I it follows 
that the ratio of time scales at the two temperatures as- 



26 



sociated with a given length L for 1ST jT <^ 1 becomes, 



TLiT) 



ro{T) 



TLiT + AT) ToiT + AT) 



exp 



L 



-V 



(A3) 



where we introduced time- separation length 

L,(A) ^ Lo |(a(A(T)/fcBr)/9T)Arri/'^ . (A4) 

The above expression means that two times become ex- 
ponentially separated if one observes dynamics on length 
scales large enough compared with the time-separation 
length L,(AT). Note that L*(AT) remains finite as long 
as AT is non-zero. Looking at the ratio of length scales 
for a given time scale t at the two temperatures one finds 
from Eq. HA2p . 



Lrit) 



0(1) 



(A5) 



independently of the chosen time scale t. Thus, the mag- 
nitude of the length scales explored at two close tem- 
peratures appears quite similar as long as the same time 
scales are used. However, we emphasize, that thermally 
activated dynamics brings about a significant hierarchy 
of time scales, in spite of an apparent mild hierarchy in 
length scales. 

Assuming that Eq. (|A2I) is applicable to the Heisen- 
berg like Ag(ll at% Mn) spin glass, Fig. I24r a') shows 
the domain growth at different temperatures in this sys- 
tem using earlier derived experimental values for the 
parameters.-^ In Fig. l24r b^ the domain growth at differ- 
ent temperatures is drawn for a 4d EA spin glass derived 
from previous numerical simulations.^^ 

In spin glass materials the microscopic time is Tm ~ 
10^^^ s and relaxation experiments are performed typ- 
ically in the range of time scales 1 — 10^ s or t/r^-i = 
10^^ — 10^*. On the other hand, in usual Monte Carlo 
simulations of EA Ising spin glass models the microscopic 
time is Tm = 1 Monte Carlo Step (MCS) and the range 
of time scales is 1 - 10*^ (MCS) or t/r^ = 1 - 10^ Be- 
cause of the slow dynamics, there is a common problem 
that the investigated 4-6 decades in time only cover a 
quite limited length scale as shown in Fig. |31 (see also 
Fig 1 of Ref. l26l|) . Due to the much shorter time scales 
probed in numerical simulations, the influence of critical 
dynamics are much stronger than in experiments for the 
same reduced temperature T jT^. It can also be seen in 
Fig. 1^ that the length scales are rather different: sim- 
ulations explore length scales of order LT(t)/To ~ 0(1) 
while experiments explore LT^it^jL^ ^ 0(10) — O(IO^). 



APPENDIX B: EXPERIMENTAL DETAILS 

1. Non-commercial SQUID magnetometer 

The experiments were performed in non-commercial 
SQUID magnetometers designed for low-field measure- 
ments and optimum temperature control. The magnetic 



field is in these set-ups generated by a small supercon- 
ducting solenoid always working in persistent mode. The 
time constant of the superconducting magnets is of or- 
der 1 ms, but the whole procedure to change the field 
from hXo h + Ah and re-establish persistent mode in the 
magnet takes ~ 0.3 s which also determines the shortest 
observation time in the ZFC relaxation experiments. In 
the case of the Fco.sMno.sTiOs sample, cut into a rect- 
angular shape (2x2x4 mm^) with the c-axis along the 
longest side, the probing field was applied along the c- 
axis of the single crystal, and for the Ag(ll at% Mn) 
spin-glass, turned into a cylindrical shape (4 mm long 
and 2 mm in diameter), the field was applied along the 
symmetry axis of the cylinder. The sample space is mag- 
netically shielded with cans of /i-metal and niobium and 
the remaining background field is < 1 mOe, while the 
measurement field used are h w 0.1 — 1 Oe. The sample 
is glued to a 50 mm long sapphire rod with a diameter of 
2 mm, and the magnetization is recorded while keeping 
the sample stationary in the center of the third coil of a 
third order gradiometer. The sapphire rod is connected 
to a solid copper cylinder on which the thermometer and 
a resistive heater are placed. The materials in the experi- 
mental setup are chosen so that the heat transfer between 
the sample and copper cylinder is maximized while the 
heat exchange with the surroundings is kept quite low 
being mainly carried by thermal conduction through the 
sample holder rod, a thin walled stainless steel tube, via 
Cu(Be) holding springs into the surrounding helium bath. 
The temperature can be kept fixed with a stability better 
than 100 using an ac-bridge based temperature con- 
trol system and with a stability better than 5 mK using a 
commercial temperature controller. The maximum cool- 
ing rate in these magnetometers is Wcooi ^ 0.05 K/s in 
the temperature ranges of these studies and, to maintain 
a good temperature control, the maximum heating rate 
is limited to Wheat ~ 0.5 K/s. The maximum heating and 
cooling rates were always employed when changing the 
temperature in the current experiments. In ac measure- 
ments, a coil generating the ac field is wound around the 
sample and a similar compensation coil is wound on the 
sample rod above the sample and positioned so that it 
becomes centered in the second pick-up coil of the gra- 
diometer. 

When measuring both the ac and dc susceptibility as 
a function of temperature, the magnetization is recorded 
on heating by elevating the temperature in steps of 0.1 - 
0.2 K. The measurement of the magnetization at constant 
temperature (including temperature setting and stabi- 
lization, and actual measurement) takes ~ 30 - 60 s, 
yielding an effective heating rate of ^ 0.005 K/s. 
The magnetization is also recorded on cooling in ac ex- 
periments yielding a cooling rate similar to the heating 
rate, while the sample is cooled using the maximum cool- 
ing rate in dc experiments. 

Since the same thermal protocols are employed in 
both dc-magnetization and ac-susceptibility measure- 
ments, the same nonequilibrium processes are probed in 
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both methods, with the difference that the ac suscep- 
tibihty can be measured at all times and temperatures 
during the thermal protocols, while the zero field cooled 
(ZFC) magnetization can only be recorded as a function 
of temperature (resp. time) after applying the probing 
field at the lowest temperature (resp. the measurement 
temperature). The magnetic fields employed in the ex- 
periments are small enough to ensure a linear response of 
the system, and do hence not affect the nonequilibrium 
dynamics. 

Some complementary magnetization measurements 
were performed using a Quantum Design MPMS5 
SQUID magnetometer in order to check the absolute sus- 
ceptibility values. 



2. Effective age of a spin glass system measured by 
ZFC relaxation 
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FIG. 25: (Color online) S{t) of ZFC relaxation measurements 
employing different wait times on (a) Ag(ll at% Mn) and (b) 
Feo.sMno.sTiOs . Tlie reduced temperature is 0.9 for botli 
samples. 



The relaxation rate S{t) determined from isothermal 
ZFC relaxation experiments is shown in Fig. 1251 The 
sample is quenched (cooled with the maximum cooling 
rate) from above Tg to the measurement temperature Tm. 
For both samples S{t) exhibits a peak at ipcak ~ ex- 
cept for the shortest waiting time = t^s = 3 s (which is 
the time needed in order to stabilize the temperature^). 
Due to the slow cooling, the system has already been 
aged for a certain effective time imin when reaching Tj^^M- 
From the measurements with 



of the system after a T-shift is determined from the 
time tpoak corresponding to the maximum of S{t), as 
tcs{tw + tmin) = (ipeak)^/'' with ^ = 1 for the Ag(ll 
at% Mn) sample at T « 30 K and /i « 0.98 - 0.99 at 
T = 17 - 19 K for the Feo.sMno.sTiOg sample.^ We no- 
tice that t„iin can only be determined from isothermal 
ZFC relaxation measurements, but not from the corre- 
sponding ac relaxation measurement. 
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FIG. 26: (Color online) S{t) curves obtained for Ag(ll at% 
Mn) after a rapid cooling ( Vcooi ~ 0.05 K/s) to Tm = 30 K 
(solid line) and after a rapid cooling to 29 K, where the sample 
was kept for 3000 s and subsequently heated rapidly ( Wheat ~ 
0.5 K/s) to Tm = 30 K (dashed line). 



In Fig. 1261 S{t) is shown after a temperature quench 
(I'cooi ^ 0.05 K/s) to Tin and after a T-shift to a tem- 
perature Ti = 29 K where it is aged for 3000 s before 
the temperature is rapidly raised {vhcat ~ 0.5 K/s) to 
Tm. The maximum of the S{t) curve of the T-shift ex- 
periment appears at tmin ~ 3 s which is considerably 
shorter time than ^ 30 s in the case of quench. 
The fact that is smaller after a positive T-shift than 
after a direct quench implies the system is completely 
dominated by the strong chaos effect. Namely, |AT| is 
so large that the intrinsic overlap length Tat < -^min, 
where Tmin is the domain size corresponding to the effec- 
tive age tmin- We cannot evaluate the value of Tat itself 
since it is masked by (on heating), (-Z^min) is 

smaller on heating than on cooling due to the faster heat- 
ing than cooling rate and the temperature dependence of 
the domain growth (c.f. Appendix . The L^nin corre- 
sponding to iniin determined here gives an upper limit for 
the renormalized overlap length L^in{vT,T) introduced 
in Sec. Ill Fl since the time needed to stabilize the temper- 
ature at Tm also contributes to imin (^min)- It is also pos- 
sible to obtain a random initial configuration with a small 
train by using a magnetic field making a "field quench" 
Throughout this article, we have however only used the 
ordinary temperature quench to initialize the system. 
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APPENDIX C: SIMULATIONAL DETAILS 

The Monte Carlo simulations were performed on the 
4 dimensional EA Ising model whose critical tempera- 
ture is Tg/J = 2.0Si. The simulations were made at the 
temperatures T/J = 1.2,0.8 {T/Tg = 0.6,0.4), which 
are well below the critical temperature so that numerical 
time/length scales are not strongly affected by critical 
fluctuations. Systems with 24^ spins were used, which 
are large enough to get rid of finite size effects within the 
numerical time window The simulations were done us- 
ing the standard heat-bath Monte Carlo method up to 
a time scale of 10^ Monte Carlo Steps (MCS) starting 
with random spin configurations in order to mimic ag- 
ing after ideal temperature quenches. The average over 
at least 32 different realizations of random bonds were 
taken. For the measurements of the ZFC susceptibilities 
320 samples were used. 

The advantage of the 4 dimensional model compared 
with the 3 dimensional EA Ising model, which might 
appear slightly more realistic, is that a rich amount of 
knowledge about the equilibrium and dynamical prop- 
erties of the model has been accumulated by indepen- 
dent studies. This includes the critical properties asso- 
ciated with the fixed point at Tgr^ the T = glassy 



fixed poinfeS^i^ and the dynamical length Lrit) obtained 
in Ref. I63l69i We note that a recent Monte Carlo 
simulation^ on the same model confirmed, to a certain 
extent, certain predictions from the fundamental dynam- 
ical scaling ansatz due to the droplet theory^®-^^-^* (in- 
cluding that for the decay of TRM (thermo remanent 
magnetization) which are all expressed in terms of the 
dynamical length scale LT{t). It is also worth to mention 
that in equilibrium Monte Carlo simulations of the model 
the anticipated signatures of the chaos effect have been 
observed both in the case of temperature changesli (ex- 
change Monte Carlo method), and bond perturbationi2i 

Unfortunately within the available computational 
power it is difficult to observe even some weak 
traces of rejuvenation by temperature changes by 
the standard heat-bath dynamical Monte Carlo 
simulations ,^^*2Si2Miil2*Sl Within feasible CPU times, 
one is forced to work at temperatures rather close to 
Tg, such as 0.8 — 0.9Tg. In this temperature range, 
the dynamics in the numerical time window is strongly 
affected by critical fluctuations, ■^^■'^''■^'^•^^ while the 
experimental time window lies well outside the critical 
regimeifi (see Fig. 124(1 . Thus we limit ourselves with 
bond-shift and cycling simulations. 
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